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METHOD AND SYSTEM FOR USING 
A HYPERLINK, BANNER, OR GRAPHICAL ICON TO 
INITIATE THE OVERLAYING OF AN OBJECT ON A WINDOW 

COPYRIGHT NOTICE 

A portion of the disclosure of this patent document contains material which is subject 
to copyright protection. The copyright owner has no objection to the facsimile reproduction 
by anyone of the patent document or patent disclosure as it appears in the Patent and 

r; Trademark office, patent file or records, but otherwise reserves all copyright rights 

J j whatsoever. 

I FIELD OF THE INVENTION 

v The present invention relates to a computer system and method for using a hyperlink, 

banner, or graphical icon to initiate the overlaying of an object in a parent window. 

*5 BACKGROUND INFORMATION 

" : There is great interest in exploiting the capabilities of the Internet World Wide Web 

("Web") by providing advertising to generate revenue for Web sites. A Web site is a 
grouping of one or more associated Web pages sharing a common domain. Each Web page is 
a document that is displayed as a single window of information. Web advertising is 

10 predominantly implemented through the use of banner advertisements on these Web pages. 
With the evolution of the Internet and the Web from an Academic to mainstream medium, 
advertising became a commercially feasible activity. 

The birth of true Web-based advertising began in 1994 with a banner advertisement 
from AT&T™ on the "hotwired.com" Web site. A banner advertisement (hereinafter 

15 "banner") is a graphic or image contained on either a Web page or a portion of a display 

screen and used for advertising. Since the pioneering AT&T™ advertisement, the banner has 
become the predominant form of Web advertising. From modest beginnings in 1994, the 
banner has today evolved into eight commonly accepted types and sizes as identified by the 
Standards and Practices Committee of the Internet Advertising Bureau (IAB). FIG. 1 is a 

20 diagram illustrating the eight commonly accepted IAB types and sizes of banner 
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advertisements. These categories are: 





Type of Banner 


Size inTixels 




Micro Button 170 


88x31 


5 


Button 150 


120x60 




Button 140 


120x90 




Square Button 160 


125 xl25 




Vertical Banner 130 


120 x 240 




Full Banner w/V ert. Navigation Bar 110 


392 x 72 


10 


Half Banner 120 


234 x 60 




Full Banner 100 


468 x 60 



* In addition to these commonly accepted banner types and sizes, countless customized 

; implementations exist catering to the specific needs of advertisers and Web site owners. The 

1 5 growth of the banner can be attributed to both advertisers' demand for finding new ways of 
I' reaching their target audiences and the desire of Web site owners to raise revenue in order to 

pay for or profit from the maintenance of their Web sites. 
f In order to judge the effectiveness of a banner in reaching a desired demographic, 

various metrics have been developed. The Coalition for Advertiser Supported Information 
20 and Entertainment (CASIE) has published a glossary of Web marketing terms. In 1 997, the 
Media Management Task Force of the IAB published voluntary guidelines for online 
advertising in their Metrics and Methodology document. Both are industry efforts to 
standardize the use of metrics in online advertising. The most frequently used metric for 
banner effectiveness is the click-through ratio (CTR). CTR is a ratio measuring the number 
25 of times a banner is clicked on to the number of times a banner is shown. For example, if a 
banner is clicked on 5 times out of the 100 times that the banner is shown, the banner has a 
CTR of 5:100 or 5%. Optimizing CTR is the focus of most Web advertising today and has 
led to further innovation in the field. 

The problem with banners is that the Web has become so saturated with them that 
30 users have learned to tune them out. In order to compensate for this user disinterest, banner 
designers have become increasingly more innovative and have provided more stimulating 
content to the banners such as animation and video (e.g., rich media). These innovations are 
still designed to maintain or increase CTR and don't address a second problem with banners. 
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Users often don't respond to banner advertisements or to hyperlinks (also known as 
"hypertext links") because they know that clicking on either will result in them being moved 
to another Web site. Users are generally at a Web site because they want to view the content 
offered and often do not want to be moved to another Web site. For this reason, CTR remains 
constant or continues to drop as users are less inclined to click through to other Web sites. 
Therefore, displaying full advertising content without taking the user away from the current 
Web site and Web page is a need that has existed for quite some time and has not been 
adequately solved until the advent of the present invention. 

In addition to Web-based advertising, the development of small-scale data display 
devices also presents a problem that has not been addressed. Small-scale display devices 
such as personal digital assistants (PDAs), Internet/Web-enabled phones, non-Web enabled 
phones with digital displays, and electronic books (e-books) have increased tremendously in 
availability but are still plagued by a limited display area. Conventional means have not 
overcome the limitations of this restricted display and the only way to present a greater 
amount of information is to provide scrolling within an application window (the window may 
be the screen display) or by displaying a new window of information. The present invention 
solves this need by providing an alternative method of reusing the display space without 
calling new windows or leaving the data already being displayed on the screen. 

The problem faced by Web-advertisers in trying to maximize the screen space used 
without effecting the underlying content attracting a user to a Web page also arises in a non- 
advertising context. Many software applications and documents may benefit from reusing the 
screen display area to provide expanded information to a user without leaving the currently 
displayed underlying information. For example, an Adobe® Acrobat document containing a 
description of a new aircraft may not want to bog a reader down in details about the engines 
used by the new aircraft. Providing a means for displaying additional engine information 
(e.g., technical illustrations) to those readers wanting this additional information while 
avoiding this additional complexity for other readers where in both instances the underlying 
data remains available to the reader is clearly advantageous but not convenient in 
conventional embodiments of window-based software applications. The present invention 
solves this need by providing a convenient means for reusing the display space while still 
displaying the underlying window of a software application. 
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SUMMARY OF THE INVENTION 

The present invention provides a method and system for using a hyperlink (also 
known as a hypertext link), banner advertisement ("banner"), or graphical icon to initiate the 
overlaying of content (e.g., a transparent advertisement or a technical illustration) with a 
5 window, such as a Web page, Adobe® Acrobat® document, PDA-based software window, or 
e-book screen. According to one example embodiment of the present invention, the 
additional content is displayed in an "overlay plane" that may be implemented using an 
intrinsic layering feature (e.g., DHTML layering) of the window's host program, the window- 
based application software. Layering allows for the fast display of the object with the 
10 window without necessitating the recalculation (i.e., rerendering) of the scene. In an 
- alternative embodiment of the present invention, the overlay plane may be directly overlaid 
> with the underlying window without using an intrinsic layering feature of the window-based 

T application. 

Z In one embodiment of the present invention, a viewer plugin-control may be used to 

15 receive and display media content to be overlaid with the window. This viewer plugin- 

i ; jl control may be a Netscape Navigator or Communicator plugin, Microsoft ActiveX control, or 

; ,=J other plugin-control. The viewer plugin-control, if installed for the window-based application 

0 (e.g., a Web browser), may be registered by the application when the application starts up. If 
| ? the viewer plugin-control is not installed, content (i.e., data types) designed for the viewer 

20 plugin-control may not be recognized by the window-based application or the user may be 
prompted to download the viewer plugin-control when the unrecognized content is 
encountered. The user may also be prompted to download a different version of the viewer 
plugin-control if a more recent version is available or if the content (i.e., data types) require a 
specific version of the viewer plugin-control. Even though the viewer plugin-control may be 

25 registered with the window-based application, a separate instance must be created for each 
use such as for each window (e.g., Web page, Adobe® Acrobat® document, PDA-based 
software window, or e-book screen) encountered with viewer plugin-control content. If the 
instantiation procedure should fail, an alternative image file may be specified and displayed in 
place of the viewer plugin-control content. In other embodiments of the present invention, a 

30 viewer plugin-control may not be necessary for the display of content according to the present 
invention. 

The overlaying process may be initiated according to one embodiment of the present 
invention by an event (e.g., click event, rollover event) or situational value (e.g., date or IP 
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address of user). In one embodiment, a click event on a hyperlink, banner, or graphical icon 
may initiate the overlaying process. The overlaying process may begin with a determination 
to see if an instance of the viewer plugin-control exists according t6 one embodiment of the 
present invention. If an instance does not already exist, a new attempt at instantiation may be 
5 performed. If this new instantiation attempt is unsuccessful, a substitute image (e.g., a JPEG 
image or a GIF image) may be overlaid with the window instead of the otherwise planned 
content. If the instantiation is successful, the media object (i.e., the content) may be retrieved. 
In an alternate embodiment of the present invention where a viewer plugin-control is not 
used, neither the instantiation process needs to occur nor will a substitute image for the 

10 content be beneficial. 

Content information may be stored in one or more files according to one embodiment 
of the present invention. A first file may be a markup language file that contains the 
formatting instructions for the content. This markup language file may be an extensible 

= Markup Language ("XML") or HyperText Markup Language ("HTML") file according to one 

i 5 embodiment of the present invention. This first file may contain formatting information 

including camera viewpoint and location, transformations, texture mapping, transitions, and 
streaming for the object or content. A second file may contain the actual contents (i.e., the 
data) of the object or content and may be in a binary or compressed binary format. 

According to one embodiment of the present invention media objects (i.e., content) 

20 may be overlaid (e.g., layered or composited) on top of each other. For example, where the 
window-based application support layering, a movie may be placed in a second layer 
displayed over an animation in a first layer where both the first and second layers are overlaid 
on top of the underlying window (e.g., Web page, Adobe® Acrobat® document, PDA-based 
software window, or e-book screen). In this example, the movie in second layer may be 

25 positioned directly above the screen area of a television 3D object in the first layer animation 
resulting in a presentation where a movie plays on the animated television inside an image. 
Placing objects on top of each other may be done using layers where layering is supported by 
the window-based host application of the window as just explained and may also be 
performed through direct overlaying (e.g., compositing) of the content (i.e., objects). When 

30 providing multimedia integration or the integration of multiple single media objects (i.e., 
content), a single layer may be used or multiple layers may be used where the underlying 
window-based application supports layering. 

In one example embodiment of the present invention, the objects (i.e., content) of the 
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overlay plane may be pre-fetched (i.e., retrieved before they are needed) and hidden. In one 
embodiment of the present invention, the hidden overlay plane may be one or more layers. 
The hidden overlay plane may be made visible when the user initiate the overlay process for 
the content. In another embodiment of the present invention, content is only retrieved when 
5 the overlay process is triggered by, for example, a user initiated event such as a click event on 
a hyperlink, banner, or graphical icon or by a non user-initiated event such as a timing event. 
According to one embodiment of the present invention, the overlay plane may be displayed 
using a variety of transitions many not available using the intrinsic functionality of the 
window-based application or not available without less efficient processing such as, for 
10 example, continually resizing and displaying a layer to achieve a zoom-in transition effect. 
~ The present invention may allow semi-transparent and transparent edges (also known as 
f "feathered edges") for the overlay plane both of which are not generally available with 
-[ conventional window-based application. For example, DHTML layers do not expressly 
T provide semi-transparent or transparent edges for layers. 

15 The present invention may use any conventional or hereto unknown future method of 

overlaying (i.e., drawing) an object with a window (e.g., compositing). In one embodiment of 

° the present invention, a method for compositing described in co-pending U.S. Patent 

r Application, Serial Number 09/620,942 with a filing date of 21 July 2000 and title "Method 
and System for Displaying a Composited Image" the entire specification and disclosure of 

20 which is expressly incorporated herein by reference may be used. According to this 

embodiment of the present invention, multiple buffering without a Z-buffer where at least one 
of the multiple buffers is implemented in addition to the window's host program (i.e., the 
window's container) may be used to composite the overlay plane (i.e., the layer or object) 
with the window in order to create a "composited image." The embodiment just described 

25 may apply where the window is a Web page in a Web browser host program. In this 

situation, the embodiment of the present invention may use the two Web browser provided 
buffers (i.e., one off-screen buffer termed the "back buffer" and an on-screen buffer termed 
the "front buffer") and at least one auxiliary buffer allocated by a viewer plugin-control to 
compose and draw the composited image. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram illustrating the eight commonly accepted IAB types and sizes of 
banner advertisements. 
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FIG. 2 is a block diagram depicting an example of a network topology illustrating the 
relationship between the Internet, users, a Web server network node, a plugin-control 
provider node, and a overlay object provider node according to one' embodiment of the 
present invention. 

FIG. 3 is an example visual basic script that detects whether an ActiveX control 
exemplary embodiment of the present invention viewer plugin-in control already exists. 

FIG. 4 is an example XML document containing the formatting information for 
viewer plugin-control content (i.e., the object) to be overlaid with the window according to 
one embodiment of the present invention. 

FIG. 5 is an example of the HTML language commands for incorporating an object as 
a layer in the Web browser example window-based application referenced here according to 
one embodiment of the present invention. 

FIG. 6 is an illustration of an example logo that may serve a graphical icon on which a 
click or other event may initiate the overlaying process according to one embodiment of the 
present invention. 

FIG. 7 is a screen image (i.e., a screen shot) of a Web browser with overlaid 
multimedia integration according to one embodiment of the present invention. 

FIGS. 8a-8e are screen images (i.e., screen shots) of a transparent transition of an 
overlay plane containing an MP3 player image overlaid with a Web page using a viewer 
plugin-control according to one embodiment of the present invention. 

FIGS. 9a-9g are screen images (i.e., screen shots) of a rotating, zoom-out transition of 
an overlay plane containing an image of a Palm Pilot™ personal digital assistant where the 
overlay plane is placed in a DHTML layer that is overlaid with a Web page using a viewer 
plugin-control according to one embodiment of the present invention. 
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FIGS. lOa-lOf are screen images (i.e., screen shots) of an animated transition of an 
overlay plane containing an animation of a.CityBug™ Scooter where the overlay plane (i.e., 
the animation) is placed in a DHTML layer that is overlaid with a Web page using a viewer 
plugin-control according to one embodiment of the present invention. 

5 

FIGS. 1 la- 1 lb are screen images (i.e., screen shots) illustrating an example of an 
interactive overlay plane where the overlay plane is animated (i.e., performs an animation) in 
response to a user action such as clicking on the overlay plane according to one embodiment 
of the present invention. 

10 

FIG. 12 is a screen image (i.e., a screen shot) of a page curl transition where the entire 
f" window or section of the window (i.e., Web page) appears to curl as if a page in a book is 
i= being turned revealing the same window or section of the window with the overlay plane 
r- overlaid on it according to one embodiment of the present invention. 

15 

FIGS. 13a-13f are screen images (i.e., screen shots) of a ripple transition (or water 
° ripple transition) of an overlay plane containing an 3D MP3 image where the overlay plane 

(i.e., the MP3 image) is placed in a DHTML layer that is overlaid with a Web page using a 
==" viewer plugin-control according to one embodiment of the present invention. 
20 

DETAILED DESCRIPTION 

The present invention provides a method and system for using a hyperlink (also 
known as a hypertext link), banner, or graphical icon to initiate the overlaying of an object in 
a window. According to the present invention, overlaying is a drawing technique where 

25 objects are overlaid with a background resulting in a final presentation where the objects and 
background appear to be integrated. Any type of media content may be used in the overlaying 
according to one embodiment of the present invention. Although the embodiments described 
herein primarily relate to browser software for the Internet World Wide Web ("Web"), 
practitioners skilled in the art will recognize that the present invention is compatible with any 

30 window-based software. For example, one embodiment of the present invention may relate to 
Adobe® Acrobat® documents. Another embodiment of the present invention may relate to 
personal digital assistant (PDA)-based software and/or electronic book (e-book) software 
where the window is generally the entire screen. In addition to the diverse scope of software 
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with which the present invention may work, the present invention may be implemented using 
either the native features of this software ox the operating system or may be implemented 
through the use of plugins or controls ("plugin-controls") which are software routines 
designed to add functionality to the host program. For example, one embodiment of the 
5 present invention may work with software that allows both dynamic third-party plugin- 
controls and transparent drawing, including browser software running on public and private 
non-Internet information networks. In this example, the present invention could be 
implemented on custom developed browser software using a private Intranet, local area 
network (LAN), metropolitan area network (MAN), wide area network (WAN), or even a 
10 wireless network. In other embodiments, the present invention may operate with software 

that does not allow third-party plugin-controls or transparent drawing. 
[ FIG. 2 is a block diagram depicting an example of a network topology illustrating the 

I- relationship between the Internet, users, a Web server network node, a plugin-control 
= provider node, and an overlay object provider node according to one embodiment of the 

1 5 present invention. The Web server network node 200, plugin-control provider node 210, and 
overlay object provider node 220 may make available one or more Web sites which users 230 
I may visit by connecting to the respective network node. A Web site is a grouping of one or 
T more associated Web pages sharing a common domain. Each Web page is a document 
: - defined using a markup language such as the HyperText Markup Language ("HTML") or the 

20 extensible Markup Language ("XML"). The Web page document contains markup language 
instructions (i.e., commands) that are interpreted by a Web browser to provide a display of 
information to a user. These markup language instructions may, for example, include 
directions for downloading a plugin-control in order to play or handle a specific media type 
(i.e., type of content) contained or referenced in the markup language document. A plugin- 
25 control may be downloaded because the content requires an absent plugin-control, because 
there is a new version of the plugin-control (automatic upgrade), or because the content 
requires a specific version of the plugin-control. In a further example, additional instructions 
may include directions for finding and displaying specific objects within the document. 
These specific objects may be a particular type of media and may necessitate the use of 
30 specific plugin-controls as previously mentioned. When a user 230 views a document such as 
a Web page, the markup language document is transmitted to the user 230 over an 
information network such as the Internet 250. The user's local Web browser application (not 
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shown) receives the document and does the interpreting of the markup language code 
resulting in a Web page being locally displayed to the user. 

Users 230a-230c are coupled to the Web server network node 200, plugin-control 
provider node 210, and the overlay object provider node 220 via an information network such 
as the Internet 250. According to the embodiment depicted in FIG. 2, Web server network 
node 200 is coupled to the Internet 250 via Tl line 240a while plugin-control provider node 
210 is coupled to the Internet 250 via Tl line 240d and overlay object network node 220 is 
coupled to the Internet 250 via Tl line 240e. In particular, each user 230 is coupled to the 
Internet 250 via a respective network interface. User 230a utilizes a narrowband network 
interface 241 comprising a dial-up connection, while users 230b-230c utilize broadband 
network interfaces respectively comprising a cable modem with cable 232b and a Tl line 
240c. Corporate user 230c includes three network nodes 235a-235c that share bandwidth on 
a local Ethernet network 233. Although FIG. 2 illustrates three users 230a-230c, it is to be 
understood that Web server network node 200, plugin-control provider node 210, and overlay 
object provider node 220 may serve any arbitrary number of users 230 limited only by the 
processing power and bandwidth available. 

User 230a illustrates an example of a typical narrowband user connected to the 
Internet 250 via a dial-up connection 241 . User 230a utilizes a personal computer 23 la and a 
modem 232a to access Internet Service Provider (ISP) 245a and navigate the Web 250 via 
Web browser software (not shown). The Web browser software permits navigation between 
various Web document servers connected to the Internet 250, that may include the front end 
server 202 at a Web server network node 200, the front end server 212 at a plugin-control 
provider node 210, and a Web server 222 at an overlay object provider node 220. In addition 
to assisting with navigation between Web servers, the Web browser software interprets the 
markup language code contained in Web documents (i.e., Web pages) and provides 
functionality for the rendering of files distributed over the Internet (e.g., through the use of 
plugins or ActiveX controls). 

User 230b illustrates an example of a typical broadband user connected to the Internet 
250 via a broadband cable connection. In particular, user 230b utilizes personal computer 
231b to transmit and receive packets of data via cable modem 232b to and from a cable 
provider ISP 245b where the packets are routed over the Internet 250 to/from front end server 
202 at Web server network node 200, front end server 212 at plugin-control provider node 
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210, and Web server 222 at overlay object provider node 220. Similar to user 230a, user 
230b may utilize browser software to navigate the Internet 250 and trie Web. 

Corporate user 230c includes network nodes 235a-235c, which are coupled to the 
Internet 250 via local Ethernet network 233, server 234, Tl line 240c of corporate user 230c. 
Network nodes 235a-235c may communicate with Web server network node 200, plugin- 
control provider node 210, and overlay object provider node 220 via local Ethernet 233, 
server 234, Tl line 240c, Internet 250, and Tl line 240a/240d/240e (respectively). Similar to 
users 230a-230b, users at network nodes 235a-235c may utilize browser software to navigate 
the Internet 250 and the Web. 

The specific nature of users 230a-230c and the methods through which they are 
coupled to the Internet 250 depicted in FIG. 2 are merely exemplary. The present invention is 
compatible with any type of Internet client and/or connection whether broadband or 
narrowband. In general, it is to be understood that users 230 may connect to the Internet 250 
using any potential medium whether it be a dedicated connection such as a cable modem, Tl 
line, DSL ("Digital Subscriber Line"), a dial-up POTS (Plain Old Telephone Service) 
connection or even a wireless connection. 

The Web server network node 200, plugin-control provider node 200, and overlay 
object provider node 220 are all examples of nodes on the Internet 250 and the Web. Web 
server network node 200 includes front end subsystem 201 and Web content system 205. 
Front end subsystem 201 provides a Graphical User Interface ("GUI") to allow users 230 to 
transmit and receive information with Web server network node 200. In particular, according 
to one embodiment, front end subsystem 201 includes front end server 202 and GUI database 
203. GUI database 203 may contain markup language (e.g., HTML or XML) specific 
information for interpreting and displaying markup language documents such as Web pages. 
In particular, GUI database 203 serves markup language documents (i.e., Web pages) to users 
230 coupled to the Web server network node 200. 

The Web server network node 200 also includes Web content system 205, which 
provides a locus for processing the content of documents, such as Web pages, for 
transmission to users via the Internet 250. Front end server 202 is coupled to Web server 206 
at Web content system 205. According to one embodiment, Web content system's 205 Web 
server 206 includes at least one processor (not shown) to perform processing of the document 
content such as locating and downloading an object or determining the appropriate plugin- 
control to play or view a MIME (Multipurpose Internet Mail Extensions) data type. 
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Additionally, Web server 206 further includes program memory (not shown) for storing 
instructions for the execution of processes such as drawing a transparent plugin-control on a 
Web page as well as other processes mentioned herein. 

The plugin-control provider node 210 includes front end subsystem 211 and Web 
content system 215. Front end subsystem 21 1 is similar to front end subsystem 201 and 
provides an interface to allow users 230 to transmit and receive information with plugin- 
control provider node 210. In the embodiment shown, front end subsystem 211 includes front 
end server 212 and GUI database 213. GUI database 213 may contain markup language 
specific information for interpreting and displaying markup language documents such as Web 
pages. In particular, GUI database 213 serves markup language-based documents (i.e., Web 
pages) to users 230 coupled to plugin-control provider node 210. The Web content system 
215 of plugin-control provider node 210 provides a locus for listing and transmitting plugin- 
controls to users via the Internet 250. Front end server 212 is coupled to Web server 216 at 
Web content system 215. According to one embodiment, Web content system's 215 Web 
server 216 includes at least one processor (not shown) to perform the listing and transmitting 
of a plugin-control to a user. Additionally, Web server 216 further includes program memory 
(not shown) for storing instructions for the execution of processes such as the listing and 
transmitting of a plugin-control to a user over the Internet 250. 

The overlay object provider node 220 does not include a front end subsystem in the 
embodiment shown in FIG. 2 as did the Web server network node 200 and the plugin-control 
provider node 210. Instead, the overlay object provider node 220 represents an embodiment 
of a network node where the front end subsystem tasks are handled by the Web content 
system's 221 Web server 222 and are not separated. Web server 222 provides an interface to 
allow users 230 to transmit and receive information with overlay object provider node 220. 
The specific information for interpreting and displaying markup language documents such as 
Web pages are stored in storage device 223 and the Web server 222 may use this information 
to serve markup language documents (i.e., Web pages) to users 230 connected to overlay 
object provider node 220. The overlay object provider node 220 provides a locus for an 
object to be incorporated into the markup document (i.e., Web page). For example, a Web 
page served to a user 230a by the Web server network node 200 may reference an object 
contained at the overlay object network node 220 which the user's 230a local Web browser 
will find and download based on the markup instructions found in the markup language 
document (i.e., Web page). According to one embodiment, Web server 222 includes at least 
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one processor (not shown) to perform the processing of a user request for and the transmitting 
of an object. Additionally, Web server 222 may further include program memory (not shown) 
for storing instructions for the execution of processes such as the processing for and the 
transmitting of an object to a user over the Internet 250. 

The Web server network node 200, plugin-control provider node 210, and overlay 
object provider node 220 are each shown as separate network nodes illustrating network 
nodes that provide a Web page, a plugin-control, or an object on a Web page, respectively, to 
a user. A practitioner skilled in the art will recognize that any two or all three of these nodes 
may be combined into one network node and as such the example network topology is not 
intended to restrict the interpretation of network node configurations. 

Further elaborating on the browser software discussed above, in the Internet world, 
Netscape's Navigator and Netscape's Communicator Web browsers (both are hereinafter 
referred to as "Navigator") and Microsoft's Internet Explorer (hereinafter "Explorer") 
overwhelmingly dominate the market for Web browsers and as such are the only two Web 
browsers discussed. However, the present invention may apply to all Web browsers as well 
as to non-Web network browsers and any window-based application that permits the use of 
plugin-controls to add increased functionality to the window-based application. The scope of 
both the Navigator and Explorer browser software is limited out of necessity and therefore 
they allow third-party software providers to extend the functionality of their browser 
software. This reliance on third-party software provider extensions to browser functionality 
arise from the very complex nature of the browser programs themselves. 

The embodiment described in the network topology in FIG. 2 where the present 
invention makes use of a plugin-control is only one exemplary embodiment. The present 
invention, as previously discussed, may also be used with non-browser window-based 
software such as Adobe® Acrobat® and screen-based PDA or e-book software applications. 
Also as previously stated, the present invention in various embodiments may use or may not 
use plugin-controls. For these reasons, FIG. 2 should neither be construed to limit the present 
invention to being information network-based or browser-based nor should the present 
invention be construed as depending on a plugin-control, though in one or more embodiments 
of the present invention a plugin-control may be used. 
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Plugins-Controls 

It is often very difficult and time-consuming to write a complex software application 
that can handle many different types of data. Additionally, it is almost impossible to cover all 
5 foreseeable data types. Therefore, many complex software applications are written to perform 
a limited task well with the option of extending the software's functionality through external 
applications. The main application uses the external applications, typically called plugins or 
controls (hereinafter plugin-control), to add to or expand on the functionality that the main 
application contains. 

10 In order for the two applications to work together in an integrated manner, they should 

= know about each other and be able to communicate with each other. Therefore, a protocol 
and a communication arrangement between the applications should exist. For example, a 
protocol using standard Unix pipes to communicate is feasible. The plugin-control can read 
commands from stdin and print responses to stdout. Like other categories of software, Web 

15 browsers have their own specific protocols to facilitate this communication. Navigator uses 
its plugin Application Programming Interface (API) while Explorer uses Object Linking and 
Embedding (OLE) objects implemented through ActiveX controls to facilitate 
communication between the main and external plugin-control applications. The use of 
external plugin-controls is transparent to the user, also allowing the plugin-controls to be 

20 nested with one plugin-control calling other plugin-controls. Navigator plugins and Explorer 
ActiveX controls accomplish the same tasks with different tools. One example embodiment 
of the present invention includes one or more Navigator plugins while another example 
embodiment of the present invention includes one or more ActiveX controls with both 
embodiments implementing a novel method of initiating the overlaying of additional media 

25 content with a document (i.e., a window) such as a Web page. The differences between the 
Navigator plugin and ActiveX plugin control embodiments of the present invention are 
generally not material to the discussion contained herein and therefore the term plugin-control 
is used in the example embodiment to refer to both unless further specified. Additionally, 
because the plugin-control used by an example embodiment of the present invention allows 

30 for additional data (i.e., objects) to be overlaid or viewed with the Web page, the plugin- 
control may be referred to as the viewer plugin-control for the sake of further clarity. 

Even though the example embodiment uses a viewer plugin-control, the present 
invention does not require the use of a plugin-control and may be implemented without using 
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a plugin-control. Additionally, the example embodiment's use of either a Navigator plugin or 
an ActiveX control as the viewer plugin-control is, in no way intended to limit the scope of the 
patent to these two embodiments of a viewer plugin-control * The present invention relates to 
the use of a hyperlink, banner, or graphical icon to initiate the overlaying of an object with the 
currently viewed document (i.e., the document containing the hyperlink, banner, or graphical 
icon) of any host and, though Web browsers are the focus of the exemplary embodiment, the 
present invention may be used with a wide variety of software applications to include PDA- 
based software and e-book software. 

Viewer Plugin-Control Registration/Installation 

A window-based application such as a Web browser may search for already installed 
plugin-controls on program startup and may register those plugin-controls. This registration 
process may find a viewer plugin-control installed for the window-based application and 
associated with the data types (e.g., MIME types) the viewer plugin-control supports. For 
example, the window-based application may search a registry of installed plugin-controls or 
may search a specific directory in order to find the already installed viewer plugin-control. 
The data types associated with the viewer plugin-control are determined by the viewer plugin- 
control file and user-specified browser preferences. For example, the viewer plugin-control 
file may specify that the viewer plugin-control handles "application/metastream" and 
"application/x-mtx" MIME types. If the viewer plugin-control and another plugin-control are 
both associated with the same data type, the window-based application may resolve this 
conflict by determining the appropriate plugin-control for the data type based on some 
resolution means. For example, if a conflict exists, a user specified preference may determine 
which plugin-control is used. In another example, if a conflict exists, the window-based 
application may associate the last plugin-control installed (i.e., the most recent of the installed 
plugin-controls that are in conflict over the data type) with the data type. If the viewer plugin- 
control is not installed, and, therefore, not registered, the data types associated with the absent 
viewer plugin-control may not be recognized by the window-based application (e.g., Web 
browser). 
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Instantiation of the Viewer Plugin-Control 

Instantiation is a conventional term describing the process whereby a particular 
instance of a desired object, such as the viewer plugin-control, is created. For example, the 
creation of an instance of the desired object may result in a copy of the object being loaded 
into local memory. According to one embodiment of the present invention, instantiation 
refers to the creation of a particular instance of the viewer plugin-control object. Instantiation 
may, according to various embodiments of the present invention, be initiated in one of a 
number of ways including: on document load, on mouse click, or during the viewer content 
downloading process. In one embodiment of the present invention, the instantiation of the 
viewer plugin-control occurs when the markup language document (e.g., Web page) calling 
for the use of the plugin-control is interpreted and loaded into memory. According to this 
embodiment, each document (e.g., Web page) that uses the viewer plugin-control will have 
their own instance of the viewer plugin-control in memory. For example, markup language 
code within the document may initiate the viewer plugin-control instantiation by calling a 
script function such as the ie detect function described in FIG. 3 below. In another 
embodiment of the present invention, instantiation may occur on mouse click or click through 
when the user clicks on the hyperlink, banner, or graphical. For example, when a user clicks 
on a hyperlink, banner, or graphical icon, the markup language source code associated with 
the link may result in the instantiation of the viewer plugin-control object. Additionally, 
instantiation may occur during the viewer content downloading process. For example, a click 
or rollover event on a hyperlink, banner, or graphical icon initiating the display of the overlay 
plane (containing one or more objects to be overlaid) with the window may result in the 
downloading of viewer content information. The downloading of viewer content may in itself 
trigger a check to determine if an instance of the viewer plugin-control already exists and, if 
not, result in an attempt at instantiating the viewer plugin-control object as shown in FIG. 3 
(discussed below). 

The document may contain specific markup language commands the cause the 
instantiation of the viewer plugin-control such as the <embed> and <object> HTML tags. 
These two HTML tags may be used to embed an instance of the viewer plugin-control in a 
Web page, layer, or section. Sections are part of Dynamic HTML and require the use an 
additional HTML tag <layer> to create. The standard HTML <embed> tag allows additional 
functions and features to be embedded in a Web page by specifying them within the <embed> 
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</embed> tags. The HTML <embed> tag is cross-platform and cross-browser compatible 
meaning that it can be interpreted by most HTML browsers running oh most, operating 
systems. The HTML <object> tag is specific to Internet Explorer running on the Microsoft 
Windows operating system. In particular, the HTML <object> tag allows additional ActiveX 

5 control functionality to be embedded in a Web page. ActiveX controls only work with 

Internet Explorer running on the Windows operating system, therefore, the HTML <object> 
tag does not provide cross-platform or cross-browser support unless used with an alternate 
<embed> tag embedded in the <object> tag. For example, the following use of HTML tags 
on a Web page allows both Explorer and Navigator to call the viewer plugin-control. 

10 <object classid="clsid:AlCCFAC6-E092-l ldl-B0Fl-00600832DB99" 

codebase-'http://www.metacreations.conVmetastream/viewer/win/metastream.cab#Version== : 

\ 2,2,0,0" width="405" height="352"> 

v <param name="Source" value="test.mts"> 

T5 <embed Src="test.mts" Type="application/metastream" Widtfr="405" Height-^ 5 2"> 
3 </embed> 

</object> 

20 Once the viewer plugin-control object has been successfully created (i.e., instantiated), 

no new instantiation (i.e., re-instantiation) may be required if the overlay plane is hidden from 
view and then later re-shown. For example, according to one embodiment of the present 
invention, if an animation is overlaid with a Web page and then the animation is hidden 
because of some new user event (e.g., a click event on another hyperlink, banner, or graphical 

25 icon) resulting in the animation disappearing (i.e., the layer or overlay plane becoming 

hidden), making the overlay plane (or layer) visible again (by clicking on a hyperlink, banner, 
or icon that initiates the overlaying process for the layer) does not require the re-instantiation 
of the viewer plugin-control. 

The instance of the viewer plugin-control may be deactivated when a triggering event 

30 such as the closing of the overlaid object, the document (i.e., Web page), or the object 

window (i.e., the overlay plane) occurs. For example, when the user exits from the currently 
displayed document (i.e., Web page), the instance of the viewer plugin-control may be 
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deactivated and, thus, a new instance of the viewer plugin-control may be needed if the user 
returns to the same Web page later. , , • 

Native Software Features 

In an alternate embodiment of the present invention, the present invention is 
implemented using the native features of the host software and/or operating and not by using 
a plugin-control. For example, in one embodiment of the present invention using a Web 
browser, the layer feature of DHTML may be used to implement an overlay plane (the use of 
the overlay plane is discussed in more detail below). Other features of the host software (e.g., 
a Web browser, PDA-based software, or e-book software) and/or operating system may also 
be used in other embodiments of the present invention rather than using a plugin-control. 

Initiating the Overlaying Process 

The process of overlaying one or more objects with a window of a window-based 
application such as a Web browser is initiated according to one embodiment of the present 
invention either by a user behavior (e.g., clicking on a hyperlink, a banner, or an icon in a 
document) or by a non-user event (e.g., a timer or timing event). For example, a user 
behavior may include a click event where the user clicks on a hyperlink, a banner, an icon, or 
another "hot spot" (an area on the document where a click or other event is defined to trigger 
an action). Another example of a user behavior is a rollover event where the user moves the 
cursor over a hyperlink, a banner, an icon, or other "hot spot" in the document. A user 
behavior may also, in another example, include spending a certain amount of time doing or 
not doing something such as spending a certain amount of time viewing a document (e.g., 
viewing a Web page). In this example, the overlaying process may be initiated after the user 
views the document for a specified period time. A user behavior may also, in another 
example, include an action such as initiating the display of a document (e.g., a Web page) or 
initiating a program. In this example, the user action may also initiate the overlaying process. 

A non-user event may include, for example, any non-user initiated event such as 
window-based application initiated event or an operating system initiated event. In one 
embodiment of the present, a non-user event may include a viewer plugin-control initiated 
event. A non-user event may, for example, include any sort of time-based event such as a 
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specified time-period expiring after the end of animation or a specified time-period expiring 
after a document stops loading. For example, 10 seconds after an animation is displayed in 
the window, a timing event may be generated initiating the overlaying process. In another 
example, 10 seconds after a window or document (e.g., a Web page or Adobe® Acrobat® 
5 document) is loaded, a timing event may be generated initiating the overlaying process. Other 
non-user events may include, among others, a request to show an object, a request for 
information from a database, or a request to load a document. For example, a window or 
document (through a server such as a Web server) may initiate a request to display an object 
without any user intervention such as in the case of rotating banners. In this example, user 
1 0 behavior may not affect the request for new banners as part of the rotating banner display. In 
another example, a document or window (through a server such as a Web server) may 
request, independent of user behavior, information from a database and, thus, initiate the 
! overlaying process. In this example, the information may be requested for a scrolling text 
I display such as stock ticker symbols and prices that are displayed in the document. In another 

1 5 example, a first document may initiate a request for a second document independent of the 

user behavior and this request for a second document or the loading of the second document 
l may initiate the overlaying process. In this example, a user navigating to a Web page 
associated with a first URL may be moved by the first Web page to another Web page 
associated with a second URL where either the request for the second Web page or the 
20 loading of the second Web page may initiate the overlaying process. Other non-user events 
may be based on user attributes and not user behavior. For example, a particular user IP 
address may initiate the overlaying process. 

The initiation of the overlaying process refers to initiating the overlaying process for 
the display of one particular overlay plane. The overlaying process may be generated 
25 separately for the display of each overlay plane. According to one embodiment of the present 
invention, the process of overlaying one overlay plane may be broken down into several 
separate steps each of which may need to be separately initiated. For example, an overlay 
plane containing references to the objects (i.e., content) in the overlay plane may be generated 
but kept hidden from the user when a document or window is first loaded into memory and 
30 displayed. Continuing in this example, when a user clicks on a hyperlink, the overlay plane is 
made visible and the object references are used to begin "streaming" (copying) the object data 
(i.e., content) to the overlay plane. In this example, the overlaying process is broken down 
into two steps (i.e., 1) creating a hidden overlay plane, and 2) making the overlay plane 
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visible and streaming the object data) each of which is separately initiated by a different event 
(document loading and a user click event, respectively). FIG. 9a (discussed in more detail 
below) shows one embodiment of the present invention where the document is a Web page 
containing several hyperlinks such as "Palm-powered" 901a. In FIG. 9a, when the Web page 
is loaded, a hidden overlay plane (in a DHTML layer as discussed later in this specification) 
may be created. When the user clicks on the "Palm-powered" 901a hyperlink in FIG. 9a, the 
overlay plane (in the DHTML layer) is overlaid with the Web page as is shown in FIG. 9g. 
The click event may be a more common user event initiating the overlaying process (or step 
in the overlaying process) and is therefore discussed in additional detail below. 

A click event can occur on a number of objects in a window or document (e.g., a Web 
page). For example, a click event on a hyperlink (i.e., text associated with a hyperlink) which 
may appear as highlighted text, such as "hy perlink as text" , may be the initiating action for 
the overlaying process. In another embodiment of the present invention, the overlaying 
process may be initiated by a click event on a banner displayed on the window. For example, 
a banner may be any size banner advertisement including the size of the example banner 
shown below. 



THIS IS A SAMPLE BANNER 



In another embodiment of the present invention, the overlaying process is initiated by a click 
event on a graphical icon displayed on the window. For example, the graphical icon can be 
any size of image including a symbol such as "©", a logo (an example of which is shown in 
FIG. 6), and a picture. FIG. 6 is an illustration of an example logo that may serve as a 
graphical icon on which a click or other event may initiate the overlaying process according 
to one embodiment of the present invention. Another embodiment of the present invention 
initiates the overlaying process by a click event on a "hot spot" (an area on the window in 
which a particular action is defined for an event) on the window or in a document. For 
example, a click event on the lower right quadrant of a mostly blank window may initiate the 
overlaying process. 

The present invention may use any conventional or hereto unknown future method of 
overlaying (i.e., drawing) an object with a window or document (e.g., compositing). In one 



NY01 282938 v 1 



20 



embodiment of the present invention, a method for compositing described in co-pending U.S. 
Patent Application, Serial Number 09/620,942 with a filing date of 21 July 2000 and title 
"Method and System for Displaying a Composited Image" the entire specification and 
disclosure of which is expressly incorporated herein by reference may be used. According to 
5 this embodiment of the present invention, multiple buffering without a Z-buffer where at least 
one of the multiple buffers is implemented in addition to the window's host program (i.e., the 
window's container) may be used to composite the overlay plane (i.e., the layer or object) 
with the window in order to create a "composited image." The embodiment just described 
may apply where the window is a Web page in a Web browser host program. In this 
1 0 situation, the embodiment of the present invention may use two Web browser provided 
- buffers (i.e., one off-screen buffer termed the "back buffer" and an on-screen buffer termed 
the "front buffer") and at least one auxiliary buffer allocated by a plugin-control to compose 
and draw the composited image. 

f5 Determine if Viewer is Present 

The overlaying process may begin with either an attempt to instantiate the viewer 

: * plugin-control, a determination of whether an instance of the viewer plugin-control exists 

(and is, therefore, available), or both according to one embodiment of the present invention 

20 where a viewer plugin-control is used. If an instance of the viewer plugin-control can not be 
instantiated and is not available, the present invention may implement similar functionality 
using alternate means. In one embodiment of the present invention, an image such as a GIF 
or JPEG of the object(s) to be overlaid (i.e., the overlay plane) may be placed in a DHTML 
layer and the layer integrated with the window using the window-based application layering 

25 features. For example, an alternate GIF of the object plane may be available and can be 

placed in a DHTML layer of Internet Explorer where Internet Explorer handles the drawing of 
the layer with the Web page (i.e., browser window). In other embodiments of the present 
invention, a DHTML layer may be used for the present invention rather than for the display of 
an image when a viewer plugin-control can not be instantiated or is not available. FIG. 8e is a 

30 screen image (i.e., a screen shot) of an overlay plane containing an MP3 player overlaid with 
a Web page using a viewer plugin-control according to one embodiment of the present 
invention. In an alternative embodiment where an instance of the viewer plugin-control can 
not be instantiated and is, therefore, not available and using FIG. 8e as an example, an 
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alternative and less advantageous effect may be achieved by having a GIF image of the MP3 
player, placing the image in a DHTML layer, and having the Web browser diaw the layer 
with the Web page. This alternative embodiment may be advantageous because it uses a 
lower quality image (e.g., a GIF image) rather than the possible innovative methods for 
drawing available to the viewer-plugin control embodiment of the present invention. In one 
example, the innovative drawing techniques specified in co-pending U.S. Patent Application, 
Serial Number 09/620,942 with a filing date of 21 July 2000 and title "Method and System 
for Displaying a Composited Image" the entire specification and disclosure of which is 
expressly incorporated herein by reference may be used. 

As previously stated, according to one embodiment of the present invention, the 
overlaying process may begin with either an attempt to instantiate the viewer plugin-control, a 
determination of whether an instance of the viewer plugin-control exists (and is, therefore, 
available), or both. According to one embodiment of the present invention, a script such as a 
Java or Visual Basic script, program, file, or module may be used to determine if the viewer 
plugin-control is present. FIG. 3 is an example Visual Basic script that detects whether an 
ActiveX control exemplary embodiment of the present invention viewer plugin-in control 
already exists. In the example Visual Basic script according to one embodiment of the 
present invention shown in FIG. 3, the function ie_detect returns a value indicating whether a 
particular instance of an ActiveX viewer plugin-control exists. The ie_detect function begins 
by setting its return value to a default of 2 (333), highlighted by arrow 1 on FIG. 3, indicating 
that the script is not able to instantiate the viewer plugin-control according to the version of 
the scripting engine available to the end-user 332. The ie_detect function then determines 
345 whether the version of the Visual Basic scripting engine being used supports the viewer 
plugin-control instantiation by examining the version of the Visual Basic scripting engine 
available to the end-user 345. For example, the CreateObject method (i.e., function) 375, 
used by the embodiment of the present invention shown in FIG. 3, is supported by VBScript 
(i.e., Visual Basic Scripting) version 2 and later. Therefore, for example, the ie_detect 
function determines whether the Visual Basic Scripting engine version is 2 or greater 345. If 
the scripting engine does not support CreateObject 375 for object instantiation (i.e., the 
scripting has a VBScript version less than 2), ie_detect will return the value of 2 previously 
set as the default on line 333 in FIG. 3. If the scripting engine does support CreateObject, the 
value returned by the ie detect function is changed to a new default value of 1 (354), 
highlighted by arrow 2, indicating that the viewer plugin-control object was not successfully 
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instantiated. The CreateObject method (i.e., function) 375 is used to attempt the instantiation 
of the viewer plugin-control as indicated by arrow 4. The success of this instantiation is 
determined by testing for the existence of the new viewer plugin-control object 384 as shown 
by arrow 5. If the new viewer plugin-control object exists (i.e., the instantiation was 
5 successful), the ie_detect return value is set to 0 (i.e., zero) 394 as shown by arrow 3, 

indicating that an instance of the viewer plugin-control exists. If the new viewer plugin- 
control does not exist (i.e., was not successfully instantiated), the previously set (see arrow 4) 
value of 1 (354) is returned by the ie_detect function. 

10 Object (Content) to be Overlaid 

.% The content to be overlaid according to the present invention may be any type of 

Z media object, such as text, animation, two-dimensional (2D) or three-dimensional (3D) 
0 graphics, movies, sound, and pictures. Data for the object may be contained in one or more 
15 files which, according to one embodiment of the present invention, may be accessed by a 
\Z viewer plugin-control. In one embodiment of the present invention the object data is stored in 
= two files where the first file contains the formatting (e.g., location and other layout) 
5 information for the data, while the second file contains the actual content data. The 

formatting data (i.e., the first file) may be stored in a markup language based document such 
20 as an XML or HTML file. The formatting information is used by the present invention to 

properly display the actual content data. The data file (e.g. the second file) may be a binary or 
compressed binary file and may contain the content data. Other embodiments of the present 
may use a different number of files each containing exclusively or in combination formatting 
and actual content data for the media content to be overlaid. 
25 FIG. 4 is an example XML document containing the formatting information for the 

content (i.e., the object) to be overlaid with the window by a viewer plugin-control according 
to one embodiment of the present invention. The XML markup language instructions may 
specify the formatting information for the scene to be created before it is overlaid with the 
window. For example, the camera location 412-415 and viewpoint 418 (both may be 
30 important in determining how a scene should be constructed and presented to a user) are 

specified in section one (marked with a bold line and the number 1 enclosed in a circle) 412- 
421 of the XML file. Specific formatting information about the object (or objects) may also 
be identified as is shown in section two 424-460 of the XML file. One example of this object 
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formatting information is the transformation information for the object that is identified in 
section three 433-442 of the XML file. Other formatting information'such as streaming and 
timing data may also be included in the XML file. Section four 463-478 provides an example 
of some streaming information for the images in the scene. As previously stated, according to 
one embodiment of the present invention, the formatting information is contained in the XML 
file while the actual content is contained in one or more additional files which may be in 
binary or compressed binary format. 

According to one embodiment of the present invention, if for some reason the viewer 
plugin-control is not correctly instantiated, an alternate image file may be specified and 
displayed as a backup means for overlaying information with the window. For example, a 
source object such as an image in JPEG or GIF format may be substituted for the viewer 
plugin-control content where no available instance of the viewer plugin-control exists. This 
source object may offer considerably less than the viewer plugin-control in terms of 
appearance, content, animation, and effects but, however, it may solve the potential 
instantiation problem and it avoids distracting the user with error messages or by creating 
additional delays while another attempt is made to generate a new instance of the viewer 
plugin-control. 

According to another embodiment of the present invention, the content may be 
displayed using features inherent in the window-based software or the operating such as, for 
example, DHTML layers. In this embodiment, formatting and content data may also be 
stored in one or more files as previously discussed. Problems with instantiation are not 
generally a concern with this embodiment (unless of course it is related to the inherent 
software feature relied upon) and, therefore, a backup means for alternate content display may 
not be required. 

Multimedia Integration 

In one embodiment of the present invention, media objects may be overlaid on top of 
each other. For example, a first object, an animation, containing a television screen may be 
overlaid on top of a Web page while a second object, a movie, may be overlaid on top of the 
animation so that the movie is running on the screen of the television in the animation. FIG. 
7 is a screen image (i.e., a screen shot) of a Web browser with overlaid multimedia 
integration according to one embodiment of the present invention. In FIG. 7, the Web 
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browser displays a Web page 700 which has a scene (i.e., an overlay plane) overlaid above 
the text of the page. This scene consists of an iPIX® (Internet Pictures Corporation) 360° 
panoramic image converted into an image 701 usable by the'present invention. The scene 
may contain 3D images such as a dresser 702 that are part of the original iPIX® image. The 
5 scene may also contain numerous forms of additional content such as 3D images shown in 
FIG. 7 by the inclusion of a 3D image of a television 703 which has been added to the 
converted iPIX® picture. Another example of additional content is video content 704 playing 
into some texture area which may consist of one or more polygons such as the screen area 704 
of the television 703. In one embodiment of the present invention, iPIX® and QuickTime 

10 VR™ panoramas are converted (either at authoring time or at display time) by the viewer 

r plugin-control into a viewer plugin-control format panorama images for use in the overlaying 
process. The edges of the overlay plane (i.e., the scene) shown in FIG. 7 are semi-transparent 

L to showcase that the overlay plane is not rendered in place of the underlying text as is 

conventionally done when an image is placed on a window (such as a Web page, Adobe® 

\ 5 Acrobat® document, PDA-based software screen, or e-book screen) but instead, the overlay 
plane is overlaid on top of the text. The use of semitransparent and transparent "soft edges" 

7;_ (which may also be termed "feathered edges") is another unique feature of the present 

I invention. 

Z The overlaying of the scene (i.e., overlay plane) may either be accomplished without 

20 using any inherent feature of the window-based application (e.g., a Web browser) or may use 
window-based application features such as the support of DHTML (Dynamic HTML) layers 
regardless of whether the embodiment of the present invention uses a viewer plugin-control. 
This overlaying of objects on top of each other may be done using the layering feature of the 
window-based application (e.g., a Web browser) where layering is specifically provided for. 

25 Where layering is specifically supported by the window-based application, the overlaying of 
objects may be performed in a single layer or in multiple layers which are then integrated with 
the window (e.g., a Web page, Adobe® Acrobat® document, PDA-based software window, or 
e-book screen). Alternatively, in one embodiment of the present invention, whether or not 
layers are supported by the window-based application and whether or not the layering feature 

30 of the window-based application is used, this overlaying of objects may be performed directly 
with the underlying window as described in co-pending U.S. Patent Application, Serial 
Number 09/620,942 with a filing date of 21 July 2000 and title "Method and System for 
Displaying a Composited Image" the entire specification and disclosure of which is expressly 
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incorporated herein by reference. In another embodiment of the present invention, alternative 
methods for compositing, overlaying, or layering may also be used either in conjunction with 
the layering feature of the window-based application or in place of a layering feature of the 
window-based application. These alternative methods may be used in place of a layering 
5 feature where the window-based application either does or does not support layering. 

The integration of different media by overlaying one media object on another is both 
useful and novel according to present invention. According to one embodiment of the present 
invention, any type of media object, such as text, animation, 2D or 3D graphics, movies (with 
or without audio), audio, and pictures, may be overlaid with any other media type in the same 
10 media space. For example, a picture may be overlaid on a 3D graphics image to generate a 
£ new scene that is in turn overlaid on a window (e.g., Web page, Adobe® Acrobat® document, 
p PDA-based software window, or e-book screen). Other conventional technologies such as 
: transparent ActiveX controls may to some degree accomplish a part of what the present 

L invention accomplishes, however, these conventional technologies rely on the underlying 
1 5 window-based program (e.g., Web browser) features and are therefore restricted to the 
!" processing speed and cross-platform compatibility of the underlying program. In one 

embodiment, the present invention does not rely on the features of the underlying window- 
•~ based program and may therefore optimize the overlaying process (i.e., optimize drawing 

speed) and achieve greater cross-platform compatibility with other window-based 
20 applications. For example, co-pending U.S. Patent Application, Serial Number 09/620,942 
with a filing date of 21 July 2000 and title "Method and System for Displaying a Composited 
Image" describes one embodiment of the present invention where drawing may be done 
outside the window-based application to speed up the drawing of the overlay plane (termed 
"compositing plane" in U.S. Patent Application, 09/620,942). 
25 In one embodiment of the present invention, the overlay plane is itself interactive and 

may contain its own hot spots, hyperlinks, banners, and graphical icons that may in turn 
initiate a second level overlaying process whereby a second overlay plane is overlaid on the 
first overlay plane. For example, in FIG. 7, when the overlay plane is first displayed, the 
screen 704 of the television 703 may be a blank "hot spot" that when clicked on by a user 
30 initiates the overlaying of a video, as a second overlay plane, into the texture area of the 

screen 704. In one embodiment of the present invention, any number of overlay planes levels 
may be used to achieve the Web page operator's or owner's desired result. In another 
example, an overlay plane may contain particular text that is used to cause by, for example, a 
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user event such as a mouse rollover on the particular text, another, second overlay plane to 
appear with a text annotation to the particular text contained in the first overlay plane. In one 
embodiment of the present invention, the interactive nature o'f the overlay plane and the 
multiple levels of overlay plane usage is independent of any multi-layering functionality made 
5 available by the window-based application for whose window the overlaying is being 
performed. 

FIGS. 1 la-1 lb are screen images (i.e., screen shots) illustrating an example of an 
interactive overlay plane where the overlay plane is animated (i.e., performs an animation) in 
response to a user action such as clicking on the overlay plane according to one embodiment 

10 of the present invention. FIGS. 1 la-1 lb display a Web page (i.e., a window) 1 100a-l 100b 

* containing an overlay plane of a scooter 1101 a- 1101b displayed on top of the Web page. 

According to the example displayed in FIGS. 1 la-1 lb, when the user clicks on the overlay 
plane scooter, an animation of the scooter object runs where the scooter folds down and then 

: reopens. FIG. 1 Of displays the scooter fully displayed before this example animation begins. 

15 In this example, when the user initiates the animation in the interactive overlay plane, the 

! *~ scooter begins to fold 1 101a as is first shown in FIG. 1 la and continues folding until it is 

fully folded 1 1 01b as is shown in FIG. lib. In this example, the user clicking on the folded 

^ scooter 1101b shown in FIG. lib may initiate an animation whereby the animation unfolds. 

The example shown in FIGS. 1 la- 1 lb of an interactive feature in the overlay plane is one of 

20 many possible interactive features that may be incorporated into the overlay plane and should 
not be construed to limit the implementation of interactive features. 

Layering and Layers 

25 According to one embodiment of the present invention, the object(s) to be overlaid 

with the window may be arranged in an overlay plane that is contained in one or more layers 
of the window-based application (e.g., a DHTML Web browser layer) wherein the use of 
layers is a feature provided for by the window-based application or operating system. In one 
embodiment of the present invention, this layer or layers may be established when the 

30 window (e.g., Web page, Adobe® Acrobat® document, PDA-based software window, or e- 
book screen) is first loaded by the window-based application and the window setup 
information (e.g., the window's/document's markup language commands) is interpreted. 
According to this embodiment, the layer may be hidden until some user behavior or non-user 
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event occurs (e.g., a user clicking on a hyperlink, banner, or graphic icon) that initiates the 
overlaying of the layer with the window. At this time, the layer becomes visible and is 
overlaid with the window. In one embodiment of the present invention where a hidden layer 
is used, the data for the object(s) in the overlay plane may be copied ("streamed") to the layer 
when the hidden layer is first created. In this embodiment, the objects are "pre-fetched" 
meaning they have been retrieved in advance of when they may be needed. In another 
embodiment of the present invention where a hidden layer is used, references for the object(s) 
in the overlay plane may be included in the layer at the time the hidden layer is created and 
the actually streaming of the object data may not occur until some user behavior or non-user 
event initiates the overlaying of the layer with the window. 

In another embodiment of the present invention, the layer may be generated after some 
user behavior or non-user event occurs initiating the overlaying process. In this embodiment, 
the overlay plane and layer may be generated together, the streaming of the object data may 
occur, and the layer (containing the overlay plane) may be made visible to the user. In an 
alternative embodiment of the present invention, the viewer plugin-control may generate an 
overlay plane outside of the window-based application when a window (e.g., Web page, 
Adobe® Acrobat® document, PDA-based software window, or e-book screen) is first loaded 
by the window-based application and the window set information (e.g., the markup language 
commands) is interpreted. For example, the loading of the window may generate a process 
(separate from the window-based application process(es)) that creates the overlay plane in 
memory and may store the overlay plane in a storage device (or keep the overlay plane in 
memory) until some behavior or event occurs triggers the overlaying process and calls for this 
information in order to overlay it with the window (e.g., Web page, Adobe® Acrobat® 
document, PDA-based software window, or e-book screen) of the window-based application 
(e.g., the Web browser). 

FIG. 5 is an example of the HTML language commands for incorporating an object as 
a layer in the Web browser example of a window-based application referenced here according 
to one embodiment of the present invention. In the example embodiment shown in FIG. 5, a 
hidden layer identified as "Scooter" is defined and positioned on the Web page 506-534. The 
hidden layer contains an object defined within the <object ...> 509 and </object> 531 HTML 
tags. As stated earlier, the object information is defined using two files according to one 
embodiment of the present invention. The first file is a markup language file containing the 
instructions on items such as the screen parameters, camera location, object location, texture 
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location, and animation. The markup language file contains all the information about where 
and how to place the object data on the layer and may be viewed as the map for the object 
data. For example in FIG. 5, this markup language file is identified as "scooter.mtx" 519 and 
is, according to this example, an XML file (the scooter.mtx file is not shown). The second 
5 file may be a binary file or files containing the actual media content, geometry, textures, and 
vectors of the object. This second binary file may be of a compressed binary format in order 
to reduce the amount of space used by the file. Using the FIG. 5 example, the media content 
file (which may be in a compressed binary format) associated with the scooter.mtx markup 
language file is "scooter. mts". The media content file is generally not identified in the 

1 0 window markup language file (partially shown in FIG. 5) but is referenced in the overlay 
plane markup language file (e.g., scooter.mtx which is not shown). FIG. 1 Of is a screen 
image (i.e., a screen shot) showing the scooter.mts media content overlaid with a Web page 
according to the directions contained in the scooter.mtx file. In another example, FIG. 4 

Z shows the contents of a different overlay plane markup language file, named "teapot.mtx" 

15 (similar to the scooter.mtx file not shown), that contains information about camera viewpoint 
and location, transformation, texture mapping, and streaming for the described scene. For 
example in FIG. 4, the media content file (which may be in compressed binary format) is 
identified as "teapot.mts" 463, 472. In the example shown in FIG. 4, the "teapot.mtx" XML 
file maps the information in the "teapot.mts" media content file (not shown because it 

20 contains binary data). As previously stated, both the XML layout (i.e., content mapping file) 
and the media content files may be specified in the hidden layer shown in first part of the 
example HTML markup language code illustrated in FIG. 5. 

The second section of the example HTML markup language code shown in FIG. 5 
displays the event handling that makes the hidden layer visible to a user. The OnMouseOver 

25 event 545 allows a rollover effect to be specified for the hyperlink, banner, or graphic image 
(e.g., a button) that initiates the overlaying process. The OnMouseOut event 542 allows 
another effect to be specified (in this case the restoration of the original state) once the mouse 
is no longer over the hyperlink, banner, or graphic image that initiates the overlaying process. 
The OnClick event causes, according to one embodiment of the present invention, the hidden 

30 layer to become visible and overlaid with the window. Other events (not shown) may cause 
the visible layer to become hidden again. 

In another embodiment of the present invention, an overlay play may be created in a 
layer that is made visible on the initial loading and display of the window (e.g., Web page, 
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Adobe® Acrobat® document, PDA-based software window, or e-book screen). In this 
embodiment, a user event or non-user event may cause the layer to become hidden. This 
alternate embodiment is the opposite of previously discussed embodiments where the overlay 
plane is added to the window. In this embodiment of the present invention, the overlay plane 
5 contains information that is not added but is removed due to some user or non-user event. 

The use of layers provides an advantageous embodiment of the present invention 
because a layer can be used to place additional content on top of the window content without 
necessitating the recompilation of the information. This provides a rapid method of 
overlaying the layer contents with the window contents. Additionally, multi-layering can be 
10 used to provide enhanced overlaying of content. For example, according to one embodiment 
of the present invention, the first layer created for the viewer plugin-control may include a 
link or refer to another viewer plugin-control object which may then be displayed in a 
f separate layer. Multi-layering may be used, inter alia, for vector animation, panoramic 

Z perspectives, moving an object in a virtual reality environment, 3D object animation without 
1 5 integrating the 3D object with any other media type, and for displaying a watermark within 

the window (e.g., Web page, Adobe® Acrobat® document, PDA-based software window, or e- 
book screen). 

r Click Through Layers 

20 

One problem with DHTML layers as currently employed in Web browsers is that it 
usually is not possible to click through the layer to objects and text behind or underneath the 
layer. One embodiment of the present invention solves this problem by implementing a script 
that is cross-platform compatible and allows a user the ability to access text and other objects 

25 underneath the layer. Another embodiment of the present invention, implements a script that 
is specific to one or more window-based applications (e.g., Web browsers) but is not 
generally cross-platform compatible. Conventional methods of allowing a user to click 
through a layer have been platform-specific, such as, for example, Comet Cursor®' s 
implementation, which uses platform specific scripts to achieve this result. The present 

30 invention may implement a script that may be cross-platform compatible or platform-specific 
and in either case, passes a click or other event in the layer to the window-based application. 
This click or event may then be acted upon by the window-based application creating the 
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perception of transparency between the layer and the underlying window. This click through 
feature may also be used to implement watermark images and text using DHTML layering. 

Transitions 

5 

The overlaying of one or more objects with a window (e.g., Web page, Adobe® 
Acrobat® document, PDA-based software window, or e-book screen) may result in a 
significant alteration to the presentation viewed by a user. In order to provide a smooth and 
graceful transition from the presentation of the window prior to the integration of the overlay 

1 0 plane to the presentation of the overlay plane with the window, transitions may be used in one 

2 embodiment of the present invention to improve the overall presentation to the user. 

Conventional DHTML layers allow only a very limited implementation of transitions. For 
example, simple positional transitions such as a simple wipe (e.g., wipe up, wipe down, wipe 

I left, and wipe right) may be implemented using conventional DHTML by moving the layer on 

"1 5 the window of a Web browser. In another example, simple zoom-in and zoom-out transitions 
may be implemented using conventional DHTML by resizing the layer to achieve the 
zooming effect. In one embodiment of the present invention, transitions may be implemented 
within a layer without the need to move or resize the layer to achieve the transition. Using the 
simple DHTML transitions as an example, the present invention, according to one 

20 embodiment, may implement a wipe transition within the layer without requiring the layer to 
move on the window. Additionally, the present invention, also according to this embodiment, 
may perform a zoom transition without requiring the resizing of the layer or non-layer 
displayed overlay plane. 

FIGS. 8a-8e are screen images (i.e., screen shots) of a transparent transition of an 

25 overlay plane containing an MP3 player image overlaid with a Web page using a viewer 

plugin-control according to one embodiment of the present invention. FIGS. 8a-8e display a 
Web page (i.e., a window) 800a-800e containing several hyperlinks including a hyperlink for 
an "MP3 Player" 801a-801e. According to the example displayed in FIGS. 8a-8e, when the 
user clicks on the "MP3 Player" hyperlink 801a-801e, an overlay plane containing an image 

30 of an MP3 player 802b-802e is gradually faded in. The presentation as seen by the user is 

illustrated in a sequential display of screen images beginning with FIG. 8a, where the user has 
not yet initiated the overlaying process, to the gradually fading in of the overlay plane 802b- 
802d shown in FIGS. 8b-8d, and finally to the overlay plane being displayed in its final form 
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802e in FIG. 8e. Though the embodiment illustrated in FIGS. 8a-8e relates to a Web page 
and uses a viewer plugin-control, the same transparent transition may be implemented in 
other embodiments of the present where a viewer plugin-control is not used and/or where the 
window is displayed for another window-based application such as an Adobe® Acrobat® 
5 document, a PDA-based software window, or an e-book screen. 

FIGS. 9a-9g are screen images (i.e., screen shots) of a rotating, zoom-in transition of 
an overlay plane containing an image of a Palm Pilot™ (i.e., a Palm Hie™) personal digital 
assistant (PDA) where the overlay plane is placed in a DHTML layer that is overlaid with a 
Web page using a viewer plugin-control according to one embodiment of the present 
10 invention. FIGS. 9a-9g display a Web page (i.e., a window) 900a-900g containing several 
p hyperlinks including a hyperlink for a "Palm-powered" handheld 901a-901g. According to 
K the example displayed in FIGS. 9a-9g, when the user clicks on the "Palm-powered" hyperlink 
1 90 1 a-90 1 g, an image of a Palm Hie™ PDA 902b-902g (part of the overlay plane and DHTML 
y layer) is gradually zoomed in (i.e., increased from a small-size until it is full-size) while at the 
15 same time, the user perspective of the Palm Hie™ (i.e., the camera angel or view) is rotated. 
~ During the transition, the DHTML layer used in FIGS. 9b-9g does not change in size or 
f location, only the object (i.e., the Palm Hie™ PDA image 902b-902g) changes within the 
; layer. The presentation as seen by the user is illustrated in a sequential display of screen 

images beginning with FIG. 9a, where the user has not yet initiated the overlaying process, to 
20 the gradually zooming in and rotating of the object in the overlay plane 902b-902e shown in 
FIGS. 9b-9e, and finally to the overlay plane being displayed in its final form 902g in FIG. 
9g. In the example illustrated in FIGS. 9a-9g, the overlay plane zooms in from the point 
where the user initiated the overlaying process (i.e., the "Palm-powered" hyperlink). In one 
embodiment of the present invention, the zoom transition (whether zooming out or zooming 
25 in) may occur, when the overlaying process is user initiated, from the point where the user 
initiated the overlaying process such as the hyperlink, banner, or graphical icon on the 
window. In another embodiment of the present invention, the zoom transition (whether 
zooming out or zooming in) may occur from any arbitrary location on the window. Though 
the embodiment illustrated in FIGS. 9a-9g relates to a Web page and uses a viewer plugin- 
30 control, the same zoom transition and/or rotating transition may be implemented in other 
embodiments of the present where a viewer plugin-control is not used and/or where the 
window is displayed for another window-based application such as an Adobe® Acrobat® 
document, a PDA-based software window, or an e-book screen. 
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FIGS. lOa-lOf are screen images (i.e., screen shots) of an animated transition of an 
overlay plane containing an animation of a CityBug Scooter™ where the overlay plane (i.e., 
the animation) is placed in a DHTML layer that is overlaid with a Web page using a viewer 
plugin-control according to one embodiment of the present invention. FIGS. lOa-lOf display 
5 a Web page (i.e., a window) lOOOa-lOOOf containing several hyperlinks including a hyperlink 
for a "CityBug Scooter" lOOla-lOOlf. According to the example displayed in FIGS. lOa-lOf, 
when the user clicks on the "CityBug Scooter" hyperlink 100 la- 100 If, an animation (which 
is part of the overlay plane and DHTML layer) of a CityBug Scooter™ 1002b-1002f is 
executed within the DHTML layer (i.e., a CityBug Scooter™ drives around inside the layer 

1 0 coming to a stop on the center of the Web page). The presentation as seen by the user is 

=1 illustrated in a sequential display of screen images beginning with FIG. 1 0a, where the user 
^ has not yet initiated the overlaying process, to the displaying of the animation 1 002b- 1 002e 

11 showing a CityBug Scooter™ driving around on the layer as displayed in FIGS. lOb-lOe, and 
h finally to the overlay plane being displayed in its final form 1002f in FIG. lOf at the end of 
T5 the animation. The example illustrated in FIGS. lOa-lOf can also be used to explain how one 

embodiment of a wipe transition may occur without requiring a layer to be moved. In this 
example, a transparent animation may run on a transparent DHTML layer (transparent 
= referring to both the animation and layer having transparent pixels through which elements of 

- ' the underlying Web page are visible) where the animation shows the overlay plane being 

20 wiped on or off the window. FIGS. 1 0b and lOf provide screen images that may provide an 
example of how an animation can be used to show a wipe transition. In one example, the 
CityBug Scooter™ may be wiped on to the layer by animating from 10b to lOf as a straight 
movement of the scooter onto the Web page. In another example, the CityBug Scooter™ may 
be wiped off the layer by animating from lOf to 1 0b as a straight movement of the scooter off 
25 the Web page. Though the embodiment illustrated in FIGS. lOa-lOf relates to a Web page 

and uses a viewer plugin-control, the same animation transition may be implemented in other 
embodiments of the present where a viewer plugin-control is not used and/or where the 
window is displayed for another window-based application such as an Adobe® Acrobat® 
document, a PDA-based software window, or an e-book screen. 
30 FIG. 12 is a screen image (i.e., a screen shot) of a page curl transition where the entire 

window or section of the window (i.e., Web page) (the "before" image of the window) 
appears to curl as if a page in a book is being turned revealing the same window or section of 
the window with the overlay plane overlaid on it (the "after" image of the window) according 
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to one embodiment of the present invention. FIG. 12 displays a Web page 1200 containing 
three hyperlinks including a hyperlink for an "MP3 Player" 1201 . According to the example 
displayed in FIG. 12, when the user clicks on the "MP3 Player" hyperlink 1201, the original 
image of the window or a section of the window 1202 appears to curl revealing a new 
5 underlying image of the window or section of the window including the overlay plane 1203. 
The overlay plane may but does not need to be included in a DHTML layer according to one 
embodiment of the present invention. A page curl as illustrated in the example in FIG. 12 is 
an innovative, advanced type of transition that is not possible to implement in conventional 
implementations of DHTML layers. 

10 FIGS. 1 3a-13f are screen images (i.e., screen shots) of a ripple transition (or water 

ripple transition) of an overlay plane containing a 3D MP3 image where the overlay plane 
(i.e., the MP3 image) is placed in a DHTML layer that is overlaid with a Web page using a 
viewer plugin-control according to one embodiment of the present invention. FIGS. 13a-13f 

Z display a Web page (i.e., a window) 1 300a- 1 300f containing three hyperlinks including a 

1 5 hyperlink for an "MP3 Player" 1 301a-1301f. According to the example displayed in FIGS. 

13a-13f, when the user clicks on the "MP3 Player" hyperlink 1301a-1301f, a ripple (or water 
ripple) effect occurs 1302b-1302e to the Web page while the 3D MP3 image 1303b-1303f 
(which is part of the overlay plane and DHTML layer) is gradually faded in. The presentation 
as seen by the user is illustrated in a sequential display of screen images beginning with FIG. 

20 13 a, where the user has not yet initiated the overlaying process, to the displaying of the ripple 
effect 1302b-1302e while the MP3 image 1 3 03b- 13 03 e is gradually faded in, and finally to 
the overlay plane being displayed in its final form 1302f in FIG. 13f at the conclusion of the 
transition and the ripple effect. Though the embodiment illustrated in FIGS. 13a-13f relates 
to a Web page and uses a viewer plugin-control, the same ripple effect transition may be 

25 implemented in other embodiments of the present where a viewer plugin-control is not used 
and/or where the window is displayed for another window-based application such as an 
Adobe® Acrobat® document, a PDA-based software window, or an e-book screen. 

According to one embodiment of the present invention, as previously stated, all the 
transitions discussed above may also be performed where the overlay plane is displayed 

30 without the use of a window-based application provided layer feature (e.g., DHTML layers). 

Another embodiment of the present invention implements the above transitions without using 
a separate plugin-control. As illustrated in FIG. 7, in one embodiment of the present 
invention, the overlay plane and the transitions may use soft edges where the boundary of the 
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overlay plane is not clearly delineated. Soft edges is a feature that is not available 
conventionally in DHTML layers. " 

User Perspective 

5 

In one embodiment of the present invention as perceived from the user's perspective, 
the user will view a window (e.g., Web page, Adobe® Acrobat® document, PDA-based 
software window, or e-book screen) containing at least one of a hyperlink, a banner, and/or a 
graphical icon. In other respects, the window (e.g., Web page, Adobe® Acrobat® document, 
JO PDA-based software window, or e-book screen) may appear for all manner and purposes like 
II any other similar window. For example, if the window is a Web page containing a news or 
f press release, the Web page will appear as any other news or press release Web page may 
=i appear. This Web page, according to one embodiment of the present invention, may include 
5 at least one hyperlink, banner, and/or graphical icon all of which may be found on Web pages 
; 15 not involved with the present invention. From the user's perspective, nothing will appear 
== unusual until some event either user initiated, such as a user initiated click event, or non-user 

"z; initiated, such as timing event, triggers the overlaying process. For example, a window (e.g., 

3 Web page, Adobe® Acrobat® document, PDA-based software window, or e-book screen) will 

not appear unusual until the user clicks on a hyperlink, banner, or graphical icon related to the 
20 present invention. The result of the triggered overlaying process may be the appearance of 
additional content overlaid on the window (e.g., Web page, Adobe® Acrobat® document, 
PDA-based software window, or e-book screen). For example, a user clicking on a Web page 
banner for an Internet bookseller may cause an advertisement in the form of a transparent 
animation to be overlaid on a portion of the Web page. In this example according to one 
25 embodiment of the present invention, the user may click on items on the Web page through 
the transparent portion of the advertisement animation which may result in the advertisement 
(i.e., the animation) being hidden from the user's view and the click event on the Web page 
being processed for the user. In this situation, according to one embodiment of the present 
invention, the advertisement animation is still present but hidden from the user so that if the 
30 user again initiates the overlaying process for this advertisement, the advertisement animation 
may only need to be made visible to the user instead of re-initiating the overlaying process 
anew. In another example, a user clicking on a hyperlink for a personal digital assistant may 
cause a fully rotatable and scalable 3D image of the PDA to appear overlaid with the window 
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(e.g., Web page, Adobe® Acrobat® document, PDA-based software window, or e-book 
screen). According to one embodiment of the present invention, the user may execute the 
same initiating function, such as clicking on the same hyperlink, to cancel the additionally 
overlaid content. For example, after the 3D image of the PDA is overlaid with the user 
5 window, the user may again click on the same hyperlink with a result that the 3D image 
disappears from the window (i.e., is no longer overlaid with the window). 

FIGS. 8a, 9a, 10a, and 13a are exemplary illustrations of a news release Web page 
containing at least three hyperlinks according to one embodiment of the present invention. 
When the user clicks on one of the hyperlinks, additional content is overlaid on the Web 
10 page. FIGS. 8a-8e are an exemplary illustration of a 3D MP3 player image content being 

overlaid with the Web page according to one embodiment of the present invention. FIGS. 9a- 
[ 9g are an exemplary illustration of a 3D PDA image content being overlaid with the Web 
L page according to one embodiment of the present invention. FIGS. lOa-lOf are an exemplary 
U illustration of a scooter animation content being overlaid with the Web page according to one 
15 embodiment of the present invention. FIG. 12 is an exemplary illustration of al 3D MP3 
=- player image content being overlaid with the Web page according to one embodiment of the 

present invention. FIGS. 13a-13f are another exemplary illustration of a 3D MP3 player 
?* image content being overlaid with the Web page according to one embodiment of the present 
r invention. The user may cancel the display of the additional content in these exemplary 

20 embodiments of the present invention by either clicking on the additional overlaid content 
(except for the scooter animation content shown in FIGS. lOa-lOf where clicking on the 
overlay plane image of the scooter causes a further animation sequence to commence as 
shown in FIGS 1 la- 1 lb) or by clicking on the hyperlink on which the user initially clicked to 
trigger the overlaying process. 

25 

Reverse Perspective 

The previous embodiments of the present invention provided examples of additional 
content added to the window (e.g., Web page, Adobe® Acrobat® document, PDA-based 
30 software window, or e-book screen) of a window-based application (e.g., Web browser, 
Adobe® Acrobat®, PDA-based software, or e-book). The reverse is also possible. In one 
embodiment of the present invention, the initiation of the overlaying process may result in the 
removal of content from a window. For example, the window may initially be displayed with 
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information contained in an overlay plane which, in one embodiment of the present invention, 
may be contained in a DHTML layer. When a user or non-user initiated event occurs 
triggering the overlaying process, the information contained in the overlay plane is either 
removed from the window display or hidden from the user (i.e., made non-visible). This is an 
5 alternative method of implementing the present invention. 

Enhanced Content & Advertising Display 

As previously mentioned, one problem with displaying content on a PDA, e-book, 
10 telephone display, and other similar displays as well as with conventional advertising on 
; either the Web or general computer-based advertising is the limited amount of space available 
-;" for the display of information (e.g., schematics, technical illustrations, banners, etc.) in a 
-. window, display screen, or Web page. This may necessitate the use of a hyperlink or other 

r mechanism to move the user from the currently displayed window or screen (or portion 

15 thereof) to another separate window or section of a window (e.g., an advertisement page in an 
= Adobe® Acrobat® document) to display additional information such as the full advertising 

content to be conveyed to the user. Additionally, Web site operators and owners as well as 
; software providers are reluctant to provide key "real estate" (locations) on a Web page, in a 

: window, or on a display screen to advertisers because it often detracts from their own content 

20 and reduces the appeal of their Web page or software to users. The present invention may 

solve both of these problems by providing an innovative method for providing expanded and 
reusable display space ("real estate") within a window (e.g., Web page, Adobe® Acrobat® 
document, PDA-based software window, or e-book screen). The ability to display an overlay 
plane on top of any area within a window (e.g., Web page, Adobe® Acrobat® document, PDA- 
25 based software window, or e-book screen) allows the present invention to display expanded 
content and/or a full-size advertisement that may incorporate sufficient additional information 
without requiring a hyperlink to another separate window. The use of an overlay plane in the 
manner described above also allows the present invention to reuse window space (the "real 
estate" of the window) for multiple advertisements and displays of content thereby enhancing 
30 a user's experience by avoiding the sending of the user (e.g., via hyperlinks) to other windows 
(e.g., Web pages, Adobe® Acrobat® documents, PDA-based software windows, or e-book 
screens) in order to obtain additional information whether that additional information is 
additional content or advertisements. The reuse of window space may also allow Web page 
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operators and owners and software providers to sell more advertising on a window thereby 
possibly improving their revenues, for example, in the operation of their Web site and Web 
pages. Additionally, the reuse of window space allows content providers (including 
advertisers) to present their content in an innovative and attention-grabbing manner that may 

5 also greatly increase the content space available for use. 

The reuse of window space may occur regardless of the type of overlaying performed 
between the overlay plane and the window according to one embodiment of the present 
invention. In other words, the display space used by an overlay plane may be reused 
regardless of the method by which the overlay plane is overlaid with the window. For 
10 example, the method of overlaying the overlay plane with a window may include using a 
blending technique (blend compositing), a replacement technique (pixel 
replacement-overwriting), or a transparent drawing technique (compositing with transparent 

~ pixels in the overlay plane). 
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WHAT IS CLAIMED IS : 

1 . A method for overlaying an object in a window of a software application, comprising the 
steps of: 

5 

receiving a request for the object, the request being initiated by a behavior of a user 
viewing the window; 

creating an overlay plane including the object as a function of the receiving step; and 

10 

S" overlaying the created overlay plane with the window. 

% 2. The method according to claim 1, wherein the window is a markup language document. 

15 3. The method according to claim 2, wherein the markup language document is an HTML 
2 document. 

1 4. The method according to claim 2, wherein the markup language document is an XML 

document. 

20 

5. The method according to claim 1, wherein the software application is a Web browser. 

6. The method according to claim 5, wherein the Web browser is at least one of Netscape 
Navigator, Netscape Communicator, and Microsoft Internet Explorer. 

25 

7. The method according to claim 1, wherein the receiving step includes receiving the request 
as a result of the user clicking on a hyperlink. 

8. The method according to claim 1, wherein the receiving step includes receiving the request 
30 as a result of the user clicking on a banner. 

9. The method according to claim 1, wherein the receiving step includes receiving the request 
as a result of the user clicking on a graphical icon. 
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10. The method according to claim 1, wherein the receiving step includes receiving the 
request as a result of the user initiating a click event. 

1 1 . The method according to claim 1, wherein the receiving step includes receiving the 
5 request as a result of the user initiating a rollover event. 

12. The method according to claim 1, wherein the receiving step includes receiving the 
request as a result of the user initiating a timing event. 

10 13. The method according to claim 1 , wherein the receiving step includes receiving the 
request as a result of the user requesting a new window to be displayed. 

1 1 4. The method according to claim 1 3 , wherein the new window is a markup language 

document. 

i-5 

-= 15. The method according to claim 14, wherein the markup language document is an HTML 

J document. 

~ 16. The method according to claim 14, wherein the markup language document is an XML 

20 document. 

17. The method according to claim 1, wherein the creating step further comprises: 

creating a layer including the object as a function of the receiving step. 

25 

1 8. The method according to claim 17, wherein the overlaying step further comprises: 

overlaying the created layer with the window. 
30 19. The method according to claim 1 8, wherein the layer is a DHTML layer. 

20. The method according to claim 1 , wherein the creating step further comprises: 
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creating a layer, the layer being created as a result of the receiving step, wherein the 
layer is hidden from the user and the layer includes a reference to the object. 

21 . The method according to claim 20, wherein the overlaying step further comprises: 

displaying the created layer to the user, wherein the reference the object initiates the 
streaming of the object data to the layer. 

22. The method according to claim 21 , wherein the layer is a DHTML layer. 

23. The method according to claim 1, wherein the creating step further comprises: 

creating a layer, the layer being created as a result of the receiving step, wherein the 
layer is hidden from the user and the layer includes the object. 

24. The method according to claim 23, wherein the overlaying step further comprises: 

displaying the created layer to the user. 

25. The method according to claim 24, wherein the layer is a DHTML layer. 

26. The method according to claim 1, wherein the creating step further comprises: 

creating an overlay image including the object as a function of the receiving step. 

27. The method according to claim 26, wherein the overlaying step further comprises: 

overlaying the created overlay image with the window. 

28. The method according to claim 1, wherein the overlay plane utilizes semi-transparent 
edges. 

29. The method according to claim 1, wherein the overlaying step includes the step of: 
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using a transition effect to display the created overlay plane, wherein the transition 
effect is at least one of a transparent transition, a rotating object transition, a zoom transition, 
an animation transition, a wipe transition, a page curl transition, and a ripple transition. 

30. The method according to claim 1, wherein the overlaying step further comprises: 

overlaying the created overlay plane with the window, wherein the overlaying is 
performed outside of the normal software application processing. 

3 1 . A method for overlaying an object in a window of a software application, comprising the 
steps of: 

receiving, by a plugin-control, a request for the object, the request being initiated by a 
behavior of a user viewing the window; 

creating, by the plugin-control, an overlay plane including the object as a function of 
the receiving step; and 

overlaying, by the plugin-control, the created overlay plane with the window. 

32. The method according to claim 31, wherein the window is a markup language document. 

33. The method according to claim 32, wherein the markup language document is an HTML 
document. 

34. The method according to claim 32, wherein the markup language document is an XML 
document. 

35. The method according to claim 3 1 , wherein the software application is a Web browser. 

36. The method according to claim 35, wherein the Web browser is at least one of Netscape 
Navigator, Netscape Communicator, and Microsoft Internet Explorer. 



NY01 282938 v 1 



42 



37. The method according to claim 31, wherein the receiving step includes receiving, by the 
plugin-control, the request as a result of the user clicking on a hyperlink. 

38. The method according to claim 31, wherein the receiving step includes receiving, by the 
5 plugin-control, the request as a result of the user clicking on a banner. 

39. The method according to claim 31, wherein the receiving step includes receiving, by the 
plugin-control, the request as a result of the user clicking on a graphical icon. 

10 40. The method according to claim 31, wherein the receiving step includes receiving, by the 
plugin-control, the request as a result of the user initiating a click event. 

41 . The method according to claim 31, wherein the receiving step includes receiving, by the 
; f| plugin-control, the request as a result of the user initiating a rollover event. 

| ft 

42. The method according to claim 31, wherein the receiving step includes receiving, by the 
u plugin-control, the request as a result of the user initiating a timing event. 

3 43. The method according to claim 31, wherein the receiving step includes receiving, by the 

20 plugin-control, the request as a result of the user requesting a new window to be displayed. 

44. The method according to claim 43, wherein the new window is a markup language 
document. 

25 45. The method according to claim 44, wherein the markup language document is an HTML 
document. 

46. The method according to claim 44, wherein the markup language document is an XML 
document. 

30 

47. The method according to claim 3 1 , wherein the creating step further comprises: 
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creating, by the plugin-control, a layer including the object as a function of the 
receiving step. 

48. The method according to claim 47, wherein the overlaying step further comprises: 

5 

overlaying, by the plugin-control, the created layer with the window, wherein the 
created layer is overlaid with the window using the software application provided mechanism 
for the display of layers. 

1 0 49. The method according to claim 48, wherein the layer is a DHTML layer. 

50. The method according to claim 47, wherein the overlaying step further comprises: 

: overlaying the created layer with the window, wherein the created layer is overlaid 

15 with the window using a plugin-control provided mechanism for the display of content with a 
window bypassing the software application provided mechanism for the display of layers. 

z 51. The method according to claim 50, wherein the layer is a DHTML layer. 

20 52. The method according to claim 3 1 , wherein the creating step includes: 

defining a layer using the software application provided functionality, wherein the 
layer definition is included in the definition of the window; and 

25 placing the created overlay plane in the defined layer. 

53. The method according to claim 52, wherein the overlaying step further comprises: 

overlaying the defined layer with the window, wherein the defined layer is overlaid 
30 with the window using the software application provided mechanism for the display of layers. 

54. The method according to claim 53, wherein the layer is a DHTML layer. 
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55. The method according to claim 52, wherein the overlaying step further comprises: 

overlaying the defined layer with the window, wherein the defined layer is overlaid 
with the window using a plugin-control provided mechanism for the display of the object in 
5 the layer with a window bypassing the software application provided mechanism for the 
display of layers. 

56. The method according to claim 3 1 , wherein the creating step further comprises: 

10 creating, by the plugin-control, a layer wherein the layer is hidden from the user and 

the layer includes a reference to the object. 

57. The method according to claim 56, wherein the overlaying step further comprises: 

1 5 displaying the defined layer to the user, wherein the reference to the object initiates 

the streaming of the object data to the layer. 

58. The method according to claim 57, wherein the layer is a DHTML layer. 

20 59. The method according to claim 3 1 , wherein the creating step further comprises: 

creating, by the plugin-control, a layer wherein the layer is hidden from the user and 
the layer includes the object. 

25 60. The method according to claim 59, wherein the overlaying step further comprises: 

displaying the defined layer to the user. 

61 . The method according to claim 60, wherein the layer is a DHTML layer. 

30 

62. The method according to claim 31, wherein the creating step includes: 
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defining a layer using the software application provided functionality, wherein the 
layer definition is included in the definition of the window, the layer is hidden from the user, 
and the layer includes a reference to the object ; and 

placing the created overlay plane in the defined layer. 

63. The method according to claim 62, wherein the overlaying step further comprises: 

displaying the defined layer to the user, wherein the reference to the object initiates 
the streaming of the object data to the defined layer which is overlaid with the window using 
the software application provided mechanism for the display of layers. 

64. The method according to claim 63, wherein the layer is a DHTML layer. 

65. The method according to claim 62, wherein the overlaying step further comprises: 

displaying the defined layer to the user, wherein the reference to the object initiates 
the streaming of the object data to the defined layer which is overlaid with the window using 
a plugin-control provided mechanism for the display of content with a window bypassing the 
software application provided mechanism for the display of layers. 

66. The method according to claim 31, wherein the creating step includes: 

defining a layer using the software application provided functionality, wherein the 
layer definition is included in the definition of the window, the layer is hidden from the user, 
and the layer includes the object ; and 

placing the created overlay plane in the defined layer. 

67. The method according to claim 66, wherein the overlaying step further comprises: 

displaying the defined layer to the user, wherein the defined layer is overlaid with the 
window using the software application provided mechanism for the display of layers. 



NY01 282938 v 1 



46 



68. The method according to claim 67, wherein the layer is a DHTML layer. 



69. The method according to claim 66, wherein the overlaying step further comprises: 

5 displaying the defined layer to the user, wherein the defined layer is overlaid with the 

window using a plugin-control provided mechanism for the display of content with a window 
bypassing the software application provided mechanism for the display of layers. 

70. The method according to claim 31, wherein the creating step further comprises: 

10 

=1 creating, by the plugin-control, a overlay image including the object as a function of 

the receiving step. 

£; 71 . The method according to claim 70, wherein the overlaying step further comprises: 

!:! 

overlaying the created overlay image with the window using the software application 
O provided mechanism for the display of content with the window. 

= ; 72. The method according to claim 70, wherein the overlaying step further comprises: 
20 

overlaying, by the plugin-control, the created overlay image with the window using a 
plugin-control provided mechanism for the display of content with a window bypassing the 
software application provided mechanism for the display of layers. 

25 73. The method according to claim 3 1 , wherein the overlay plane utilizes semi-transparent 
edges. 

74. The method according to claim 31, wherein the overlaying step includes the step of: 

30 using a transition effect to display the created overlay plane, wherein the transition 

effect is at least one of a transparent transition, a rotating object transition, a zoom transition, 
an animation transition, a wipe transition, a page curl transition, and a ripple transition. 
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75. A method for overlaying an object in a window of a software application, comprising the 
steps of: 

creating an overlay plane including the object; 

overlaying the created overlay plane with the window; 

displaying the window overlaid with the created overlay plane; 

receiving a request, the request being initiated by a behavior of a user viewing the 
window overlaid with the created overlay plane; and 

displaying the window without the overlay plane as a function of the receiving step. 

76. A method for overlaying an object in a window of a software application, comprising the 
steps of: 

creating, by the plugin-control, an overlay plane including the object; 

overlaying, by the plugin-control, the created overlay plane with the window; 

displaying, by the plugin-control, the window overlaid with the created overlay plane; 

receiving, by a plugin-control, a request, the request being initiated by a behavior of a 
user viewing the window overlaid with the created overlay plane; and 

displaying the window without the overlay plane as a function of the receiving step. 

77. A system for overlaying an object in a window of a software application, comprising: 

a program memory; 
a storage device; and 
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a processor, wherein the processor is adapted to: 



(i) receive a request for the object, the request being initiated by a behavior of 
a user viewing the window; 

(ii) creating an overlay plane including the object as a function of the receiving 

step; and 

(iii) overlaying the created overlay plane with the window. 

78. The system according to claim 77, further including: 

a browser program and a browser plugin-control, executing in the processor, the 
browser plugin-control causing the processor to: 

(i) receive a request for the object, the request being initiated by a behavior of 
a user viewing the window; 

(ii) creating an overlay plane including the object as a function of the receiving 

step; and 

(iii) overlaying the created overlay plane with the window. 

79. The system according to claim 78, wherein the browser program is at least one of 
Netscape Navigator, Netscape Communicator, and Microsoft Internet Explorer. 

80. The system according to claim 78, wherein the browser plugin-control is defined using 
the Netscape Application Programming Interface (API). 

81. The system according to claim 78, wherein the browser plugin-control is at least one of a 
Netscape Navigator plugin and a Netscape Communicator plugin. 
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82. The system according to claim 78, wherein the browser plugin-control is an ActiveX 
control. 

83. A set of instructions residing in a storage medium, the set of instructions capable of being 
executed by a processor to implement a method for overlaying an object in a window of a 
software application, the method comprising the steps of: 

receiving a request for the object, the request being initiated by a behavior of a user 
viewing the window; 

creating an overlay plane including the object as a function of the receiving step; and 
overlaying the created overlay plane with the window. 

84. A set of instructions residing in a storage medium, the set of instructions capable of being 
executed by a processor to implement a method for overlaying an object in a window of a 
software application, the method comprising the steps of: 

receiving, by a plugin-control, a request for the object, the request being initiated by a 
behavior of a user viewing the window; 

creating, by the plugin-control, an overlay plane including the object as a function of 
the receiving step; and 

overlaying, by the plugin-control, the created overlay plane with the window. 

85. A method for initiating the overlaying of an object with a window of a software 
application, comprising the steps of: 

clicking by a user an element of the window; 

creating a layer as a function of the clicking step; and 
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overlaying the created layer with the window. 

86. The method according to claim 85, wherein the window is a Web'page. 

87. The method according to claim 85, wherein the software application is a Web browser. 

88. The method according to claim 87, wherein the Web browser is at least one of Netscape 
Navigator, Netscape Communicator, and Microsoft Internet Explorer. 

89. The method according to claim 85, wherein the clicking step includes clicking by a user a 
hyperlink in the window. 

90. The method according to claim 85, wherein the clicking step includes clicking by a user a 
banner in the window. 

91 . The method according to claim 85, wherein the clicking step includes clicking by a user a 
graphical icon in the window. 

92. The method according to claim 85, wherein the clicking step includes clicking by a user a 
hot spot on the window. 
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303 ' this pointer is used to try to instantiate the ActiveX Control 

306 Dim Pluginobj 
309 

312 ' function: ie_detect() 

315 ' purpose : This VBscript will try to detect the plug-ins for IE 4.0 and up. It attempts 

318 ' to create the ActiveX Controls passed to it, checks for successful creation, 

321 ' then destroys them. This script will be ignored by Netscape browsers. 

324 Function ie_detect(objectName) 
327 

330 ' return value - defaults to not detectable unless otherwise set later 

333 ie_detect = 2 < 

336 

339 ' CreateObject is only supported with VBScript version 2+, so 

342 1 only do the check if it is supported. Otherwise, return false 

345 if ScriptEngineMaj orVersion >= 2 then 
348 

351 'Indicates that the control is detectable 

354 ie_detect = 1 < 
357 

360 ' Ignore errors if possible, if the client has a script debugger installed, 

363 ' this error handling will not work, but it should not be needed 

366 On Error Resume Next 
369 

372 'Create ActiveX Control Instantiation 

375 Set Plugin_obj = CreateObject(objectName) ^ 
378 

381 'Check whether Control was properly instantiated 

384 if IsObject(Plugin_obj) then < 
387 

391 'Indicates that the control has been found 

394 ie_detect = 0 < 

395 end if 
396 

397 end if 

398 End Function 

399 ' END FILE 
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403 <?xml version-' 1 .0"?> 
406 <MTSScene Version="2" > 

409 <MTSSceneParms EdgeBias- ' 1 " /> 

412 <MTSCamera WalkMode="0" OrbitDist="4 M > — — ^— 
415 <Rotate x="35.62254" y="30.69068" z="0"/> 

418 <ViewLocation x="0" y="0" z="4" /> 

421 </MTSCamera> 

424 <MTSObject Name-'teapot" > — — — — — 
427 <MTSObjectName="teapot" > 

430 <MTSObjectName="teapot_MESH_0" > 

43|| <Transform Type="current" > — ^ ^ — 

43f:, <Scalex="0.01" y="0.01" z="0.01"/> 

4m <Positionx="-0.06733" y="-0.48965" z="-0.00177" /> 

44|i: </Transform> ^ — — — 

44g <MTSMaterial Name="teapot_MATERIAL_0" ID="0" > 

44fe <MTSTextureMap Type="Diffuse" Name="teapot_TEXTURE_0" /> 

451; </MTSMaterial> 
454 </MTSObject> 
457 </MTSObject> 

46a </MTSObject> "— mm ~ mmmmmmmmm ~^^^^^^^^^^^^^^^^^^^^^^^~ 

46f <MTSTimeElem Name="teapot" Type-'MTSStream" On="l" Path="teapot.mts" > ■ 
465" <Target Name="teapot" /> 

46g </MTSTimeElem> 



ID 



47§ <MTSTimeElem Name="teapot_anim" Type="MTSStream" On="l" Path="teapot.mts" : 

47® <Target Name="teapot" /> 

478 </MTSTimeElem> 

481 </MTSScene> 



O 
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503 <td align=LEFT valign=TOP width="60" height=" 1 00"> 

506 <div id="Scooter" style="position:absolute; Ieft:70px; top:140px; width:505px; height:359px; z-index:l; visibility: hidden 1 - 
509 <object id="MetaStreamCtl" 

classid="CLSID:03F998B2-OEOO-HD3-A498-00104B6EB52E" 
width=500 
height=360> 

5 1 S <embed component="ISceneComponent" componentfilename="SceneComponent.mtc" 

so\Sce="vw_bug_mts.mtx" type— 'application/x-mtx" width=532 height=448 border="true" script="true"> 
5 IP </embed> 

5 1 f? <param name="Source" value="scooter.mtx"> 

52tJ <param name— 'Component" value="ISceneComponent"> 

52ft-! <param name="ComponentFileName" value- 'SceneComponent.mtc"> 

52§J <param name-'BroadcastKey" Value="bff921b6aede2839bedf8603c4348ee87d58535a-lda0- 

wvov.metastream. com"> 

531" </object> 

534 </div> 

sm </td> 



53|J <a href-"#" 

542' onMouseOut="MM_swapImgRestore()" 

545 onMouseOver="MM_swapImage('Image 1 ',",'images/Scoot_01 -over.gif , 1 )" 

548 onClick="MM_showHideLayers('MP377hide7TWideo77h^^^ 

<img src="images/Scoot_01.gif width="105" height="18" align="absbottom" border="0" name- 'Image 1"> 

</a> 
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New devices demonstrate the "cool factor" 

By Dmitry Paperny, Metastream .com 

Handheld computers, Internet appliances and other gadgets will be the 
central focus of the four-day trade show, which begins with a series of 
seminars. A total of 5,000 visitors are expected to attend the demo of 
Metastream Hyperad technology, said a spokesman for Metastream Expo, 
the show's sponsor. 



Company A, for instance, will offer the first glimpse of its highly anticipated 
Palm-powered handheld. Chip start-up MetaTrans will display future 
notebooks, a MetaExpo staple, but with a twist; the portables will contain 
the company's Robin processor. 

Meanwhile, Glory will show off a new MP 3 player and a system-based 





Internet terminal at technology events going 

Keynote speakers include Corp 1 CEO Jin 
Oozos, who is expected to ride in on a shir 
k executives from the traditionad PC makers 2 
appearance. 
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New devices demonstrate the "cool factor" 

By Dmitry Paperay, Metretreamsgm 



Handheld computers, internet appliances and other gadgets will be the 
central focus of the four-day trade show, which begins with a series of 
seminars. A total of 5,000 visitors are expected to attend the demo of 
Metastream Hyperad technology, said a spokesman for Metastream Expo, 
the show's sponsor. 

Company A, for instance, will offer the first glimpse of its highly anticipated 

aim-powered handheld. Chip start-up MetaTrans will display future 
notebooks, a MetaExpo staple, but with a twist; the portables wall contain 
the company's Robin processor. 



Meanwhile, Glory will show off anew MP 3 player and a. system-based 
Internet terminal at technology events going on elsewhere in New York. 

Keynote speakers include Corp 1 GEO Jim Jones and Corp 3 CEO John 
Oozos, who i3 expected to ride in on a shiny new CityBug Scooter , but 
executives from the traditional PC makers are not set to make an 
appearance. 
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Handheld computers, Internet appliances and other gadgets will be the 
central focus of the four-day trade show, which begins with a series of 
seminars. A total of 5,000 visitors are expected to attend the demo of 
Metastream Hyperad technology, said a spokesman, for Metastream Expo, 
the show'sppsaaso: 
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the company's Robin processor. 



Meanwhile, Glory will show off anew MP3 player and a system-based 
Internet terminal at technology events going on elsewhere in New York. 

Keynote speakers include Corp 1 CEO Jim Jones and Corp 3 CEO John 
Oozos, who is espected to ride in on a shiny new QtyBug Scooter , but 
executives from the traditional PC makers are not set to make an 
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New devices demonstrate the "cool factor" 

By Dmitry Papemy, Metastreamjom 

Handheld computers, Internet applianceg and other gadgets will be the 
central focus of the four-day trade show, which begins with a series of 
seminars. A total of 5,000 visitors are expected to attend the demo of 
Metastream Hyperad technology, said a spokesman for Metastream Expo, 
the show's sponsor. 

Company A, for instance, will offer the first glimpse of its highly anticipated 
Palm-powered handheld. Chip start-up MetaTrans will display future 
notebooks, a MetaEnpo staple, but -with a twist; the portables will contain 
the company's Robin processor. 

Meanwhile, Glory will show off a new MP 3 player and a system-based 
Internet terminal at technology events going on elsewhere in New York. 
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Keynote speakers include Corp 1 GEO Jim Jones and Corp 3 GEO John 
Oozos, who is expected to ride in on a shiny new CityBug Scooter , but 
executives from the traditional PC makers are not set to mal^ an 
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Meanwhile, Glory will show off anew MP3 player and a system-based 
Internet terminal at technology events going on elsewhere in New York. 

Keynote speakers include Corp 1 CEO Jim Jones and Corp 3 CEO John 
Oozos, who is expected to ride in on a shiny new CityBug Scooter , but 
executives from the traditional PC makers are not set to makfc an 
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Meanwhile, Glory will show off a new MP3 player and a system-based 
Internet terminal at technology events going on elsewhere in New York. 

Keynote speakers include Corp 1 CEO Jim Jones and Corp 3 CEO John 
Oozos, who is expected to ride in on a shiny new CityBug Scooter , but 
executives from the traditional PC makers are not set to makfc an 
appearance. 
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Meanwhile, Glory will show off a new MP3 player and a system-based 
Internet terminal at technology events going on elsewhere in New York. 

Keynote speakers include Corp 1 CEO Jim Jones and Corp 3 CEO John 
Oozos, who is espected to ride in on a shiny new CityBug Scooter , but 
executives from the traditional PC makers are not set to make an 
appearance. 
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Meanwhile, Glory will show off a new MP3 player and a system-based 
Internet terminal at technology events going on elsewhere in New York. 

Keynote speakers include Corp 1 CEO Jim Jones and Corp 3 CEO John 
Oozos, who is expected to ride in on a shiny new CityBug Scooter , but 
executives from the traditional PC makers are not set to make an 
appearance. 
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By Dmitry Fapemy, Metagtreaiti.com 

Handheld computers, Internet appliances and other gadgets will be the 
central focus of the four-day trade show, which begins with a series of 
seminars. A total of 5,000 visitors are expected to attend the demo of 
Metastream Hyperad technology, said a spokesman for Metastream Expo, 
the show's sponsor. 

Company A, for instance, will offer the first glimpse of its highly anticipated 
Palm-powered handheld. Chip start-up MetaTrans will display future 
notebooks, a MetaExpo staple, but -with a twist; the portables will contain 
the company's Robin processor. 



Meanwhile, Glory will show off a new MP3 player and a system-based 
Internet terminal at technology events going on i Isewhere in New York. 
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U.S. DEPARTMENT OF COMMERCE 
PATENT AND TRADEMARK OFFICE 



DECLARATION 



ATTORNEY'S DOCKET NO. 

2509/250 



As a below named inventor, I hereby declare that: 

My residence, post office address, and citizenship are as stated below next to my name. 

I believe I am an original, first, and joint inventor of the subject matter that is claimed and for 
which a patent is sought on the invention entitled METHOD AND SYSTEM FOR USING A 
HYPERLINK, BANNER, OR GRAPHICAL ICON TO INITIATE THE OVERLAYING OF 
AN OBJECT ON A WINDOW, for which an application for Letters Patent is being filed in the 
United States Patent and Trademark Office herewith. 



I hereby state that I have reviewed and understand the contents of the above identified 
specification, including the claims. 

I acknowledge the duty to disclose information which is material to the examination of this 
application in accordance with Title 37, Code of Federal Regulations, § 1.56(a). 



SEND CORRESPONDENCE, AND DIRECT TELEPHONE CALLS TO: 

Michelle M. Carniaux, Esq. 
KENYON & KENYON 
One Broadway 
New York, New York 10004 
(212) 425-7200 (phone) 
(212) 425-5288 (facsimile) 



I declare that all statements made herein of my own knowledge are true and all statements made 
on information and belief are believed to be true; and further that these statements were made with the 
knowledge that willful false statements and the like so made are punishable by fine or imprisonment, or 
both, under § 1001 of Title 18 of the United States Code and that such willful statements may 
jeopardize the validity of the apphcation or any patent issuing thereon. 
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PAPERNY 


FIRST GIVEN NAME 

Dmitry 


SECOND GIVEN NAME 
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New York 


STATE OR FOREIGN 
COUNTRY 

New York 


COUNTRY OF 
CITIZENSHIP 

Russia 


POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

210 W. 10 th Street, #4C 


CITY 

New York 


STATE & ZIP 
CODE/COUNTRY 

New York 10014 


^x^"^ — - Date io !nlw 
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INVENTOR 


FAMILY NAME 

KOTAY 


FIRST GIVEN NAME 

Sreekant 


SECOND GIVEN NAME 
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CITIZENSHIP 


CITY 

Richboro 


STATE OR FOREIGN 
COUNTRY 

Pennsylvania 


COUNTRY OF 
CITIZENSHIP 

United States 


POST OFFICE 
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POST OFFICE ADDRESS 

54 Florence Drive 
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Richboro 
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CODE/ COUNTRY 

Pennsylvania 
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APPOINTMENT OF POWER OF ATTORNEY 
BY ASSIGNEE OF ENTI RE INTEREST 



VIEWPOINT CORPORATION as assignee of the entire right, title, and interest in the 
application for patent entitled METHOD AND SYSTEM FOR USING A HYPERLINK, BANNER, 
OR GRAPHICAL ICON TO INITIATE THE OVERLAYING OF AN OBJECT ON A 
WINDOW, for which an application for Letters Patent is being filed in the United States Patent and 
Trademark Office herewith, does hereby appoint John Flock (Registration No. 39,670) and Michelle M. 
Carniaux (Registration No. 36,098), as my attorneys with full power of substitution and revocation, to 
prosecute this application and to transact all business in the Patent and Trademark Office connected 
therewith. 

Please address all communications regarding this application to: 



Michelle M. Carniaux, Esq. 
KENYON & KENYON 
One Broadway 
New York, New York 10004 



Please direct all telephone calls to Michelle M. Carniaux at (212) 425-7200. 



VIEWPOINT CORPORATION 
498 Seventh Avenue 
Suite 1810 

New York, NY 10018 





Position: Vice President and General Counsel 
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